-- Logs begin at Mon 2022-05-23 11:48:20 UTC, end at Mon 2022-05-23 12:54:36 UTC. -- May 23 12:23:37.811991 dv-cinder-836996-27-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 23 12:23:37.821587 dv-cinder-836996-27-iscsi devstack@n-api.service[103108]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 23 12:23:37.823527 dv-cinder-836996-27-iscsi devstack@n-api.service[103108]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 23 12:23:37 2022] *** May 23 12:23:37.823527 dv-cinder-836996-27-iscsi devstack@n-api.service[103108]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 23 12:23:37.823527 dv-cinder-836996-27-iscsi devstack@n-api.service[103108]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 23 12:23:37.823527 dv-cinder-836996-27-iscsi devstack@n-api.service[103108]: nodename: dv-cinder-836996-27-iscsi May 23 12:23:37.823527 dv-cinder-836996-27-iscsi devstack@n-api.service[103108]: machine: x86_64 May 23 12:23:37.823527 dv-cinder-836996-27-iscsi devstack@n-api.service[103108]: clock source: unix May 23 12:23:37.823527 dv-cinder-836996-27-iscsi devstack@n-api.service[103108]: pcre jit disabled May 23 12:23:37.823527 dv-cinder-836996-27-iscsi devstack@n-api.service[103108]: detected number of CPU cores: 4 May 23 12:23:37.823527 dv-cinder-836996-27-iscsi devstack@n-api.service[103108]: current working directory: / May 23 12:23:37.823527 dv-cinder-836996-27-iscsi devstack@n-api.service[103108]: detected binary path: /usr/bin/uwsgi-core May 23 12:23:37.824244 dv-cinder-836996-27-iscsi devstack@n-api.service[103108]: your processes number limit is 47680 May 23 12:23:37.824244 dv-cinder-836996-27-iscsi devstack@n-api.service[103108]: your memory page size is 4096 bytes May 23 12:23:37.824244 dv-cinder-836996-27-iscsi devstack@n-api.service[103108]: detected max file descriptor number: 2048 May 23 12:23:37.824244 dv-cinder-836996-27-iscsi devstack@n-api.service[103108]: lock engine: pthread robust mutexes May 23 12:23:37.824244 dv-cinder-836996-27-iscsi devstack@n-api.service[103108]: thunder lock: enabled May 23 12:23:37.824244 dv-cinder-836996-27-iscsi devstack@n-api.service[103108]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 23 12:23:37.824244 dv-cinder-836996-27-iscsi devstack@n-api.service[103108]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 23 12:23:37.868376 dv-cinder-836996-27-iscsi devstack@n-api.service[103108]: Python main interpreter initialized at 0x563a7e6839c0 May 23 12:23:37.868376 dv-cinder-836996-27-iscsi devstack@n-api.service[103108]: python threads support enabled May 23 12:23:37.868376 dv-cinder-836996-27-iscsi devstack@n-api.service[103108]: your server socket listen backlog is limited to 100 connections May 23 12:23:37.868376 dv-cinder-836996-27-iscsi devstack@n-api.service[103108]: your mercy for graceful operations on workers is 90 seconds May 23 12:23:37.868752 dv-cinder-836996-27-iscsi devstack@n-api.service[103108]: mapped 403077 bytes (393 KB) for 2 cores May 23 12:23:37.868831 dv-cinder-836996-27-iscsi devstack@n-api.service[103108]: *** Operational MODE: preforking *** May 23 12:23:37.869031 dv-cinder-836996-27-iscsi devstack@n-api.service[103108]: *** uWSGI is running in multiple interpreter mode *** May 23 12:23:37.869031 dv-cinder-836996-27-iscsi devstack@n-api.service[103108]: spawned uWSGI master process (pid: 103108) May 23 12:23:37.869215 dv-cinder-836996-27-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 23 12:23:37.869749 dv-cinder-836996-27-iscsi devstack@n-api.service[103108]: spawned uWSGI worker 1 (pid: 103109, cores: 1) May 23 12:23:37.872211 dv-cinder-836996-27-iscsi devstack@n-api.service[103108]: spawned uWSGI worker 2 (pid: 103110, cores: 1) May 23 12:23:37.872211 dv-cinder-836996-27-iscsi devstack@n-api.service[103108]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 23 12:23:39.050062 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 23 12:23:39.050598 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 23 12:23:39.779875 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 12:23:39.779875 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: from cryptography.utils import int_from_bytes May 23 12:23:39.780859 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 12:23:39.780859 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: from cryptography.utils import int_from_bytes May 23 12:23:39.784294 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 12:23:39.784294 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: from cryptography.utils import int_from_bytes May 23 12:23:39.784889 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 12:23:39.784889 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: from cryptography.utils import int_from_bytes May 23 12:23:42.407537 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 12:23:42.408378 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 12:23:42.408474 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 12:23:42.408766 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 12:23:42.408962 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 12:23:42.409333 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 12:23:42.409433 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 12:23:42.409521 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.409713 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.409814 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 12:23:42.410043 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.410142 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 12:23:42.410333 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 12:23:42.410444 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.410684 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.410787 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.410996 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.411092 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.411320 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.411413 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.411637 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.411723 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.411965 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.412051 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.412250 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.412342 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.412710 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.412816 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.412906 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-27-iscsi {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.412993 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.413205 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.413304 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.413462 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.413560 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.413774 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.413867 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.414097 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-27-iscsi {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.414189 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.414415 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.414510 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.414719 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.414813 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.415026 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.415118 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.415341 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.415527 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.415631 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.415950 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.416274 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.416403 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.416594 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.416776 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.416975 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.417165 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.417356 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.417543 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.417739 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.417927 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.418126 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.418320 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.418505 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.418706 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.418857 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.419084 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.419236 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.419457 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.419616 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.419833 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.420029 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-27-iscsi {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.420231 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.420383 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.420603 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.420808 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.420994 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-27-iscsi {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.421153 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.421377 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.421377 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.421707 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.421863 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.422004 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.422004 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.422353 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.422520 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.422654 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.422790 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.422927 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.423057 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.423208 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.423381 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.423519 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.423661 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.423792 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.423922 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.424046 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.424184 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.424309 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.424453 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.424613 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.424740 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.424869 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.425002 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.425132 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.425269 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.425394 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.425522 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.425652 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.425776 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.425906 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.426050 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.426176 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.426300 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.426429 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.426553 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.426684 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.426814 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.426946 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.427076 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.427268 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.427403 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.427540 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.427670 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.427795 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.427919 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.428048 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.428212 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.428355 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.428494 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.428618 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.428791 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.428931 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.429103 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.429230 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.429414 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.429552 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.429714 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.429847 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.430017 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.430149 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.430323 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.430463 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.430622 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.430756 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.430923 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.431049 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.431224 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.431357 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.431539 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.431674 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.431848 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.431981 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.432183 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.432344 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.432547 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.432685 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.432817 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.432941 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.433135 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.433260 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.433399 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.433529 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.433689 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.433822 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.434021 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.434155 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.434336 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.434472 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.434642 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.434780 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.434955 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.435082 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.435270 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.435404 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.435573 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.435701 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.435873 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.436001 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.436232 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.436359 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.436495 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.436620 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.436792 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.436927 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.437090 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.437224 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.437354 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.437479 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.437610 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.437742 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.437907 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.438034 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.438223 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.438362 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.438525 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.438661 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.438826 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.439451 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.439822 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.439949 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.440141 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.440299 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.440478 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.440605 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.440790 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.440917 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.441101 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.441235 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.441412 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.441554 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.441722 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.441858 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.442031 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.442165 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.442336 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.442474 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.442687 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.442822 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.442955 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.443086 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.443231 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.443358 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.443551 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.443684 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.443856 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.443990 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.444156 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.444596 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.444744 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.444885 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.445049 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.445178 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.445366 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.445493 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.445669 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.445804 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.445972 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.446101 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.446279 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.446417 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.446579 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.446715 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.446880 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.447008 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.447198 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.447324 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.447498 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.447631 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.447799 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.447927 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.448107 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.448252 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.448430 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.448570 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.448732 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.448865 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.449043 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.449169 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.449345 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.449484 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.449646 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.449780 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.449946 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.450073 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.450246 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.450385 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.450546 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.450674 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.450850 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.450978 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.451145 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.451285 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.451445 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.451572 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.451740 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.451874 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.452054 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.452229 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.452394 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.452521 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.452703 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.452852 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.453003 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.453104 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.453305 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.453400 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.453621 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:23:42.453715 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.453949 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.454046 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.454277 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.454364 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.455179 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.455282 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.455526 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.455825 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.455911 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.456155 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.456278 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.456494 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.456593 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.456825 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.456913 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.457141 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.457227 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.457454 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.457542 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.457771 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.457858 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.458082 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.458182 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.458396 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.458490 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.458708 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.458795 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.459024 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.459198 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.459340 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.459427 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.459658 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.459746 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.459972 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.460058 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.460316 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.460461 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.460631 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.460770 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.460945 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.461079 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.461256 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.461382 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.461662 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.461791 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.461917 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.462049 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.462174 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.462297 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.462499 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.462627 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.462843 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.462987 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.463152 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.463280 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.463465 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.463599 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.463778 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.463919 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.464083 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.464239 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.464415 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.464557 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.464709 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.464851 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.465031 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.465172 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.465361 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.465495 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.465671 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.465799 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.465981 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.466108 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.466286 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.466411 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.466593 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.466725 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.466899 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.467034 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.467207 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.467334 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.467513 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.467649 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.467836 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.467961 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.468146 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.468324 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.468460 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.468592 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.468772 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.468898 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.469086 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.469212 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.469393 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.469519 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.469698 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.469836 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.470005 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.470177 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.470420 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.470647 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.470787 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.470991 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.471119 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.471328 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.471455 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.471641 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.471744 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.471946 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.472051 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.472288 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.472379 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.472605 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.472692 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.472909 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.472995 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.473221 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.473314 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.473530 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.473621 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.473838 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.473937 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.474146 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.474233 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.474453 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.474545 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.474771 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.474864 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.475061 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.475156 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.475366 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.475454 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.475668 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.475764 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.475983 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.476077 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.476315 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.476408 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.476636 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.476734 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.476948 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.477043 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.477260 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.477347 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.477574 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.477672 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.477884 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.477970 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.478194 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.478280 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.478501 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.478588 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.478807 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.478900 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.479116 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.479203 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.479435 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.479529 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.479747 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.479840 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.480057 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.480150 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.480409 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.480511 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.480732 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.480831 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.481030 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.481125 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.481342 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.481447 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.481654 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.481751 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.481959 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.482064 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.482257 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.482343 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.482564 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.482650 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.482864 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.482960 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.483164 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.483251 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.483464 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.483550 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.483766 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.483861 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.484065 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.484152 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.484393 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.484490 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.484694 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.484782 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.484995 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.485082 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.485294 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.485381 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.485598 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.485684 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.486463 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.486571 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.486894 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.486988 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.487246 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.487414 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.487589 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.487725 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.487915 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.488073 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.488273 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.488414 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.488577 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.488756 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.488901 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.489091 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.489218 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.489404 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.489536 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.489717 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.489852 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.490028 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.490168 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.490344 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.490493 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.490652 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.490813 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.490967 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.491135 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.491281 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.491449 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.491589 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.491779 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.491929 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.492081 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.492239 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.492425 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.492556 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.492734 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.492863 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.493056 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.493184 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.493401 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.493489 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.493739 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.493827 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.494060 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.494147 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.494385 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.494470 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.494695 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.494781 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.495019 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.495106 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.495334 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.495421 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.495649 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.495737 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.495954 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.496040 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.496288 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.496379 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.496598 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.496686 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.496907 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.496993 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.497213 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.497317 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.497521 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.497608 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.497835 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.497922 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.498141 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.498242 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.498454 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.498547 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.498759 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.498844 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.499074 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.499173 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.499379 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.499465 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.499690 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.499783 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.499992 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.500088 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.500323 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.500413 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.500648 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.500736 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.500962 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.501067 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.501274 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.501361 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.502142 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.502265 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.502454 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.502765 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.502851 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.503078 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.503173 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.503397 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.503492 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.503712 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.503804 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.504027 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.504114 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.504365 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.504466 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.504684 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.504778 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.505001 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.505086 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.505307 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.505403 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.505614 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.505704 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.505918 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.506011 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.506232 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.506318 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.506538 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.506624 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.506842 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.506928 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.507144 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.507232 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.507453 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.507547 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.507758 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.507844 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.508071 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.508164 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.508408 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.508494 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.508717 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.508803 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.509019 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.509156 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.509322 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.509409 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.509641 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.509736 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.509949 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.510034 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.510249 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.510334 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.510549 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.510644 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.510848 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.510934 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.511174 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.511271 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.511488 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.511588 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.511788 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.511882 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.512099 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.512262 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.512449 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.512548 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.512756 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.512849 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.513068 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.513161 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.513374 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.513461 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.513681 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.513760 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.513991 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.514076 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.514300 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.514387 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.514605 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.514692 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.514910 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.514996 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.515216 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.515347 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.515523 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.515618 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.515827 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.515913 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.516140 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.516288 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.516470 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.516557 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.516777 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.517066 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.517237 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.517398 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.517561 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.517717 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.518028 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.518198 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.518347 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.518435 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.518669 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.518908 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.518995 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.519240 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.519327 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.519557 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.519643 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.519877 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.519972 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.520215 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.520320 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.520535 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.520623 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.520866 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.520952 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.521181 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.521310 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.521491 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.521593 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.521798 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.521910 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.522107 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.522211 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.522409 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.522545 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.522712 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.522799 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.523018 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.523102 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.523319 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.523406 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.523619 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.523706 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.523919 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.524014 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.524250 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.524339 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.524555 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.524641 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.524855 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.524954 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.525153 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.525239 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.525453 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.525540 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.525760 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.525856 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.526060 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.526147 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.526363 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.526448 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.526661 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.526754 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.526980 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.527067 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.527283 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.527370 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.527582 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.527677 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.527880 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.527973 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.528214 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.528305 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.528535 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.528623 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.528839 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.528924 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.529172 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.529259 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.529477 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.529570 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.529782 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.529868 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.530094 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.530189 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.530399 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.530484 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.530705 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.530789 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.531008 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.531106 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.531318 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.531424 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.531619 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.531725 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.531924 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.532030 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.532249 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.532347 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.532556 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.532704 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.533017 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.533168 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.533305 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.533601 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.533741 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.534016 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.534118 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.534330 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.534418 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.534634 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.534730 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.534943 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.535038 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.535246 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.535333 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.535556 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.535660 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.535858 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.535957 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.536159 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.536304 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.536480 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.536568 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.536785 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.536879 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.537086 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.537172 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.537385 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.537471 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.537691 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.537777 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.537987 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.538081 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.538299 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.538385 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.538598 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.538696 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.538896 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.538982 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.539194 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.539283 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.539497 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.539586 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.539800 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.539885 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.540095 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.540207 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.540449 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.540538 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.540753 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.540839 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.541051 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.541146 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.541372 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.541514 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.541715 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.541841 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.542017 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.542190 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.542317 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.542404 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.542622 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.542719 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.542933 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.543033 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.543238 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.543325 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.543536 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.543621 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.543839 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.543933 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.544139 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.544246 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.544462 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.544559 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.544763 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.544851 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.545066 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.545160 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.545364 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.545451 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.545661 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.545756 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.545958 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.546052 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.546256 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.546343 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.546555 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.546651 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.546873 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.546961 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.547178 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.547272 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.547476 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.547575 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.547775 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.547862 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.548072 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.548183 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.549010 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.549107 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.549326 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.549570 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.549656 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.549932 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.550030 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.550239 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.550326 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.550551 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.550647 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.550860 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.550948 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.551165 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.551252 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.551471 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.551596 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.551785 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.551872 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.552088 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.552204 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.552426 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.552523 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.552734 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.552832 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.553040 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.553128 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.553341 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.553442 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.553640 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.553728 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.553951 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.554037 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.554258 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.554353 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.554563 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.554650 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.554873 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.554959 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.555191 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.555286 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.555501 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.555588 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.555800 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.555886 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.556104 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.556228 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.556439 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.556525 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.556742 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.556826 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.557047 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.557136 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.557353 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.557440 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.557658 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.557744 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.557962 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.558049 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.558268 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.558354 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.558573 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.558659 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.558877 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.558964 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.559177 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.559263 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.559480 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.559568 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.559785 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.559872 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.560082 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.560236 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.560427 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.560555 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.560733 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.560874 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.561036 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.561180 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.561341 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.561494 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.561647 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.561808 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.561951 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.562125 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.562252 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.562440 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.562671 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.562780 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.562984 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.563154 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.563289 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.563467 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.563588 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.563780 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.563918 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.564663 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.564974 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.565062 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.565286 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.565474 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.565597 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.565792 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.565935 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.566098 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.566218 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.566520 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.566637 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.566823 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.566917 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.567131 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.567216 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.567441 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.567527 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.567742 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.567838 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.568044 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.568199 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.568377 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.568513 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.568700 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.568823 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.569003 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.569504 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.569597 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.569820 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.569916 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.570134 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.570220 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.570446 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.570530 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.570765 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.570860 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.571092 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.571178 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.571401 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.571488 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.571717 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.571862 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.572031 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.572161 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.572382 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.572490 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.572712 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.572826 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.573032 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.573160 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.573349 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.573449 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.573657 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.573755 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.573981 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.574079 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.574300 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.574395 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.574608 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.574703 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.574927 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.575036 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.575249 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.575346 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.575554 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.575657 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.575865 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.575984 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.576182 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.576284 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.576506 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.576594 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.576824 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.576912 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.577131 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.577218 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.577449 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.577545 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.577779 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.577872 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.578088 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.578176 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.578415 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.578511 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.578722 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.578808 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.579034 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.579121 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.579346 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.579441 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.579720 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.579944 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.580105 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.580351 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.580458 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.580665 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.580761 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.580972 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.581060 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.581297 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.581393 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.581597 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.581683 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.581911 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.581998 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.582218 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.582315 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.582524 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.582613 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.582825 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.582913 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.583131 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.583314 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.583447 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.583543 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.583743 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.583829 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.584050 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.584145 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.584388 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.584475 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.584709 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.584796 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.585028 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.585116 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.585330 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.585416 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.585651 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.585738 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.585956 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.586105 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.586257 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.586345 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.586557 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.586644 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.586859 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.586946 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.587200 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.587287 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.587505 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.587591 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.587821 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.587909 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.588127 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.588232 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.588467 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.588567 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.588778 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.588873 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.589084 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.589171 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.589390 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.589486 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.589700 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.589795 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.590005 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.590100 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.590311 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.590407 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.590616 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.590704 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.590916 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.591002 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.591225 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.591319 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.591527 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.591614 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.591833 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.591927 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.592134 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.592253 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.592464 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.592554 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.592764 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.592867 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.593062 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.593150 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.593363 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.593460 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.593678 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.593773 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.593979 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.594077 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.594296 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.594389 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.594601 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.594688 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.594901 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.594989 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.595280 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.595370 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.595600 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.595850 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.596002 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.596273 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.596390 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.596578 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.596677 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.596910 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.596999 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.597225 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.597320 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.597546 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.597633 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.597871 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.597958 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.598177 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.598271 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.598489 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.598575 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.598800 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.598887 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.599109 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.599340 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.599428 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.599672 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.599760 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.599992 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.600086 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.600332 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.600423 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.600642 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.600729 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.600949 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.601042 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.601258 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.601345 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.601567 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.601662 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.601878 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.601964 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.602192 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.602405 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.602506 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.602730 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.602819 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.603042 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.603129 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.603361 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.603498 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.603660 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.603768 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.603970 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.604087 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.604302 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.604428 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.604610 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.604746 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.604919 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.605067 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.605224 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.605429 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.605519 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.605746 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.605835 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.606056 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.606152 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.606375 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.606473 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.606690 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.606790 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.607005 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.607093 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.607315 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.607403 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.607629 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.607725 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.607946 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.608033 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.608297 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.608388 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.608611 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.608714 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.608911 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.608998 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.609221 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.609362 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.609530 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.609619 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.609838 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.609932 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.610144 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.610231 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.610450 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.610544 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.611279 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.611388 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.611745 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.611832 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.612213 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.612341 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.612644 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.612731 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.612961 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.613121 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.613277 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.613364 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.613603 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.613701 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.613933 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.614030 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.614251 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.614338 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.614563 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.614687 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.614876 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.614980 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.615190 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.615276 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.615541 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.615708 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.615855 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.616019 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.616181 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.616380 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.616499 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.616702 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.616817 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.617022 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.617128 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.617338 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.617435 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.617651 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.617757 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.617971 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.618079 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.618273 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.618542 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.618641 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.618866 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.618961 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.619171 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.619276 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.619472 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.619567 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.619788 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.619885 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.620095 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.620207 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.620420 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.620533 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.620734 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.620829 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.621037 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.621140 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.621365 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.621566 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.621686 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.621913 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.622008 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.622237 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.622348 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.622565 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.622665 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.622888 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.622983 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.623202 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.623297 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.623508 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.623629 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.623820 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.623916 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.624126 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.624250 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.624456 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.624543 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.624769 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.624857 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.625073 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.625172 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.625373 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.625466 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.625673 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.625761 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.625976 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.626071 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.626281 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.626366 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.627148 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.627329 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.627464 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.627757 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.627876 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.628067 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.628206 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.628403 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.628540 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.628714 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.628847 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.629027 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.629153 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.629337 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.629447 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.629649 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.629739 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.630004 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.630095 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.630325 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.630421 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.630628 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.630716 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.630927 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.631013 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.631235 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.631338 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.631535 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.631623 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.631840 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.631934 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.632141 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.632273 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.632475 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.632563 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.632777 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.632868 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.633081 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.633169 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.633428 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.633646 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.633732 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.633987 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.634094 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.634311 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.634405 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.634619 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.634705 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.634928 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.635024 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.635246 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.635341 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.635556 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.635654 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.635863 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.635951 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.636200 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.636291 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.636520 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.636607 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.636837 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.637049 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.637137 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.637387 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.637485 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.637706 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.637811 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.638039 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.638126 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.638349 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.638435 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.638660 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.638749 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.638961 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.639046 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.639267 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.639363 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.639577 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.639664 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.639884 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.639978 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.640212 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.640303 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.640525 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.640614 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.640832 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.640919 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.641137 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.641225 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.641444 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.641539 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.641750 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.641844 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.642109 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.642244 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.642414 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.642663 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.642792 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.643024 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.643118 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.643342 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.643440 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.643659 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.643798 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.643978 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.644091 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.644308 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.644421 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.644653 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.644749 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.644967 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.645078 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.645280 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.645378 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.645591 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.645688 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.645900 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.646005 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.646207 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.646302 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.646512 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.646608 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.646818 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.646922 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.647128 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.647221 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.647452 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.647546 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.647762 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.647854 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.648064 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.648162 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.648470 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.648563 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.648802 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.648902 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.649113 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.649206 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.649422 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.649520 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.649726 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.649816 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.650035 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.650126 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.650352 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.650451 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.650659 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.650751 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.650963 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.651054 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.651266 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.651370 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.651575 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.651665 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.651881 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.651974 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.652203 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.652309 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.652514 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.652606 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.652852 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.652948 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.653129 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.653229 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.653425 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.653530 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.653726 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.653859 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.654048 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.654185 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.654334 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.654422 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.654636 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.654725 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.654933 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.655020 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.655237 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.655324 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.655536 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.655623 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.655835 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.655931 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.656133 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.656265 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.656456 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.656553 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.656759 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.656845 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.657055 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.657148 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.657353 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.657467 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.657750 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.657887 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.658053 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.658141 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.658370 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.658600 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.658696 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.658905 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.658993 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.659213 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.659302 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.659515 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.659610 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.659817 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.659904 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.660115 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.660266 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.660442 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.660553 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.660742 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.660870 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.661069 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.661168 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.661399 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.661486 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.661710 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.661797 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.662027 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.662123 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.662339 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.662427 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.662657 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.662744 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.662962 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.663062 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.663281 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.663377 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.663599 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.663686 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.663910 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.663998 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.664238 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.664329 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.664582 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.664708 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.664870 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.664969 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.665174 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.665271 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.665479 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.665568 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.665785 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.665874 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.666090 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.666177 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.666395 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.666492 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.666713 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.666806 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.667017 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.667105 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.667318 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.667416 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.667639 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.667727 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.667951 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.668038 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.668287 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.668390 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.668600 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.668687 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.668907 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.668997 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.669231 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.669327 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.669536 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.669624 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.669840 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.669927 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.670149 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.670237 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.670453 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.670540 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.670757 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.670844 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.671067 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.671155 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.671341 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 12:23:42.671427 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.671684 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.672005 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.672340 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.672662 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.672984 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.673865 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.674353 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.674853 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.675189 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.675504 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.675815 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.676117 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:23:42.676383 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 12:23:42.731302 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: INFO dbcounter [None req-bab9534d-8092-46d4-aaf2-4da3c88801e0 None None] Registered counter for database nova_api May 23 12:23:42.735493 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: INFO dbcounter [None req-f1b26532-0ac0-47b5-bde5-bc35b69880e8 None None] Registered counter for database nova_api May 23 12:23:42.753549 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG oslo_db.sqlalchemy.engines [None req-bab9534d-8092-46d4-aaf2-4da3c88801e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 12:23:42.755962 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG oslo_db.sqlalchemy.engines [None req-f1b26532-0ac0-47b5-bde5-bc35b69880e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103110) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 12:23:42.760343 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG dbcounter [-] [103109] Writer thread running {{(pid=103109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 12:23:42.762401 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG dbcounter [-] [103110] Writer thread running {{(pid=103110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 12:23:42.818240 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.context [None req-bab9534d-8092-46d4-aaf2-4da3c88801e0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1aae0ced-cc5a-42cd-a102-e511b8435b39(cell1) {{(pid=103109) load_cells /opt/stack/nova/nova/context.py:464}} May 23 12:23:42.822650 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG oslo_concurrency.lockutils [None req-bab9534d-8092-46d4-aaf2-4da3c88801e0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:23:42.824228 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG oslo_concurrency.lockutils [None req-bab9534d-8092-46d4-aaf2-4da3c88801e0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:23:42.825038 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG oslo_concurrency.lockutils [None req-bab9534d-8092-46d4-aaf2-4da3c88801e0 None None] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:23:42.827036 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG oslo_concurrency.lockutils [None req-bab9534d-8092-46d4-aaf2-4da3c88801e0 None None] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:23:42.827321 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.context [None req-f1b26532-0ac0-47b5-bde5-bc35b69880e8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1aae0ced-cc5a-42cd-a102-e511b8435b39(cell1) {{(pid=103110) load_cells /opt/stack/nova/nova/context.py:464}} May 23 12:23:42.829061 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: INFO dbcounter [None req-bab9534d-8092-46d4-aaf2-4da3c88801e0 None None] Registered counter for database nova_cell0 May 23 12:23:42.831850 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG oslo_concurrency.lockutils [None req-f1b26532-0ac0-47b5-bde5-bc35b69880e8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:23:42.833322 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: INFO dbcounter [None req-bab9534d-8092-46d4-aaf2-4da3c88801e0 None None] Registered counter for database nova_cell1 May 23 12:23:42.833431 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG oslo_concurrency.lockutils [None req-f1b26532-0ac0-47b5-bde5-bc35b69880e8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:23:42.834206 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG oslo_concurrency.lockutils [None req-f1b26532-0ac0-47b5-bde5-bc35b69880e8 None None] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:23:42.836158 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG oslo_concurrency.lockutils [None req-f1b26532-0ac0-47b5-bde5-bc35b69880e8 None None] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:23:42.838175 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: INFO dbcounter [None req-f1b26532-0ac0-47b5-bde5-bc35b69880e8 None None] Registered counter for database nova_cell0 May 23 12:23:42.840528 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG oslo_db.sqlalchemy.engines [None req-bab9534d-8092-46d4-aaf2-4da3c88801e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 12:23:42.842537 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: INFO dbcounter [None req-f1b26532-0ac0-47b5-bde5-bc35b69880e8 None None] Registered counter for database nova_cell1 May 23 12:23:42.843217 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG oslo_db.sqlalchemy.engines [None req-bab9534d-8092-46d4-aaf2-4da3c88801e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 12:23:42.850109 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG oslo_db.sqlalchemy.engines [None req-f1b26532-0ac0-47b5-bde5-bc35b69880e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103110) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 12:23:42.850549 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG dbcounter [-] [103109] Writer thread running {{(pid=103109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 12:23:42.851833 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG dbcounter [-] [103109] Writer thread running {{(pid=103109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 12:23:42.853275 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG oslo_db.sqlalchemy.engines [None req-f1b26532-0ac0-47b5-bde5-bc35b69880e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103110) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 12:23:42.857105 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG dbcounter [-] [103110] Writer thread running {{(pid=103110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 12:23:43.001071 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: INFO dbcounter [None req-bab9534d-8092-46d4-aaf2-4da3c88801e0 None None] Registered counter for database nova_cell0 May 23 12:23:43.002805 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG dbcounter [-] [103110] Writer thread running {{(pid=103110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 12:23:43.009810 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG oslo_db.sqlalchemy.engines [None req-bab9534d-8092-46d4-aaf2-4da3c88801e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 12:23:43.012399 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: INFO dbcounter [None req-f1b26532-0ac0-47b5-bde5-bc35b69880e8 None None] Registered counter for database nova_cell0 May 23 12:23:43.014113 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG dbcounter [-] [103109] Writer thread running {{(pid=103109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 12:23:43.019412 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG oslo_db.sqlalchemy.engines [None req-f1b26532-0ac0-47b5-bde5-bc35b69880e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103110) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 12:23:43.024332 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG dbcounter [-] [103110] Writer thread running {{(pid=103110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 12:23:43.358706 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: WARNING keystonemiddleware.auth_token [None req-bab9534d-8092-46d4-aaf2-4da3c88801e0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 12:23:43.358994 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: WARNING keystonemiddleware.auth_token [None req-f1b26532-0ac0-47b5-bde5-bc35b69880e8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 12:23:43.366238 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: WARNING keystonemiddleware.auth_token [None req-f1b26532-0ac0-47b5-bde5-bc35b69880e8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 12:23:43.366371 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: WARNING keystonemiddleware.auth_token [None req-bab9534d-8092-46d4-aaf2-4da3c88801e0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 12:23:43.712430 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: WARNING keystonemiddleware.auth_token [None req-f1b26532-0ac0-47b5-bde5-bc35b69880e8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 12:23:43.713479 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: WARNING keystonemiddleware.auth_token [None req-bab9534d-8092-46d4-aaf2-4da3c88801e0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 12:23:43.718232 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: WARNING keystonemiddleware.auth_token [None req-f1b26532-0ac0-47b5-bde5-bc35b69880e8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 12:23:43.719303 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: WARNING keystonemiddleware.auth_token [None req-bab9534d-8092-46d4-aaf2-4da3c88801e0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 12:23:43.724209 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563a7e6839c0 pid: 103110 (default app) May 23 12:23:43.725519 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563a7e6839c0 pid: 103109 (default app) May 23 12:23:43.726582 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi [None req-f1b26532-0ac0-47b5-bde5-bc35b69880e8 None None] Calling method '>' {{(pid=103110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:23:43.727773 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: INFO nova.api.openstack.requestlog [None req-f1b26532-0ac0-47b5-bde5-bc35b69880e8 None None] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001997 May 23 12:23:43.728487 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: [pid: 103110|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 788 bytes} [Mon May 23 12:23:43 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:25:02.755945 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi [None req-bab9534d-8092-46d4-aaf2-4da3c88801e0 None None] Calling method '>' {{(pid=103109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:25:02.757199 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: INFO nova.api.openstack.requestlog [None req-bab9534d-8092-46d4-aaf2-4da3c88801e0 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002064 May 23 12:25:02.757637 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: [pid: 103109|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 930 bytes} [Mon May 23 12:25:02 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:25:02.770006 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG dbcounter [-] [103110] Writing DB stats nova_api:SELECT=3 {{(pid=103110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:25:02.770923 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG dbcounter [-] [103110] Writing DB stats nova_cell0:SELECT=3 {{(pid=103110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:25:02.771899 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG dbcounter [-] [103110] Writing DB stats nova_cell1:SELECT=3 {{(pid=103110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:25:02.772637 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG dbcounter [-] [103110] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:25:03.204343 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi [None req-e8b7ddfe-109d-4761-b562-6c8e9402517a admin admin] Calling method '>' {{(pid=103110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:25:03.240772 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: INFO nova.api.openstack.requestlog [None req-e8b7ddfe-109d-4761-b562-6c8e9402517a admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.474737 May 23 12:25:03.241794 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: [pid: 103110|app: 0|req: 2/3] 10.222.0.16 () {60 vars in 1291 bytes} [Mon May 23 12:25:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:25:05.501068 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi [None req-bab9534d-8092-46d4-aaf2-4da3c88801e0 None None] Calling method '>' {{(pid=103109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:25:05.502074 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: INFO nova.api.openstack.requestlog [None req-bab9534d-8092-46d4-aaf2-4da3c88801e0 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 May 23 12:25:05.502462 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: [pid: 103109|app: 0|req: 2/4] 10.222.0.16 () {54 vars in 930 bytes} [Mon May 23 12:25:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:25:05.562692 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi [None req-3142dce2-cb57-429e-a923-c500e22769b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "disk": 1, "swap": 0, "rxtx_factor": 1.0, "name": "cirros256", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 256}} {{(pid=103110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:25:05.581990 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 12:25:05.581990 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: warnings.warn(msg) May 23 12:25:05.611825 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: INFO nova.api.openstack.requestlog [None req-3142dce2-cb57-429e-a923-c500e22769b7 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.103239 May 23 12:25:05.612408 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: [pid: 103110|app: 0|req: 3/5] 10.222.0.16 () {64 vars in 1282 bytes} [Mon May 23 12:25:05 2022] POST /compute/v2.1/flavors => generated 407 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 12:25:05.829584 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi [None req-dc2093b3-74a7-4757-bbf4-830b43e14207 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:25:05.831965 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 12:25:05.831965 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: warnings.warn(msg) May 23 12:25:05.852990 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG dbcounter [-] [103109] Writing DB stats nova_api:SELECT=3 {{(pid=103109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:25:05.853863 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG dbcounter [-] [103109] Writing DB stats nova_cell1:SELECT=3 {{(pid=103109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:25:05.854837 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG dbcounter [-] [103109] Writing DB stats nova_cell0:SELECT=3 {{(pid=103109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:25:05.855706 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG dbcounter [-] [103109] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:25:05.909857 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: INFO nova.api.openstack.requestlog [None req-dc2093b3-74a7-4757-bbf4-830b43e14207 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.289316 May 23 12:25:05.911196 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: [pid: 103109|app: 0|req: 3/6] 10.222.0.16 () {64 vars in 1335 bytes} [Mon May 23 12:25:05 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:25:08.237709 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi [None req-3142dce2-cb57-429e-a923-c500e22769b7 admin admin] Calling method '>' {{(pid=103110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:25:08.239445 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: INFO nova.api.openstack.requestlog [None req-3142dce2-cb57-429e-a923-c500e22769b7 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002042 May 23 12:25:08.240248 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: [pid: 103110|app: 0|req: 4/7] 10.222.0.16 () {54 vars in 930 bytes} [Mon May 23 12:25:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:25:08.368627 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi [None req-e86216cd-8549-4ed0-8934-adb18d48c03e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 5, "rxtx_factor": 1.0, "id": "d1", "os-flavor-access:is_public": true, "swap": 0}} {{(pid=103109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:25:08.386524 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 12:25:08.386524 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: warnings.warn(msg) May 23 12:25:08.404921 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: INFO nova.api.openstack.requestlog [None req-e86216cd-8549-4ed0-8934-adb18d48c03e admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.158658 May 23 12:25:08.412908 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: [pid: 103109|app: 0|req: 4/8] 10.222.0.16 () {64 vars in 1282 bytes} [Mon May 23 12:25:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 12:25:08.417826 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi [None req-2a8a814f-80db-4c6d-a0c2-92ccc3064f9b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:25:08.419318 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 12:25:08.419318 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: warnings.warn(msg) May 23 12:25:08.451845 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: INFO nova.api.openstack.requestlog [None req-2a8a814f-80db-4c6d-a0c2-92ccc3064f9b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037710 May 23 12:25:08.452725 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: [pid: 103110|app: 0|req: 5/9] 10.222.0.16 () {64 vars in 1335 bytes} [Mon May 23 12:25:08 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:25:10.772312 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi [None req-e86216cd-8549-4ed0-8934-adb18d48c03e admin admin] Calling method '>' {{(pid=103109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:25:10.773345 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: INFO nova.api.openstack.requestlog [None req-e86216cd-8549-4ed0-8934-adb18d48c03e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 May 23 12:25:10.773741 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: [pid: 103109|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 930 bytes} [Mon May 23 12:25:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:25:10.836106 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi [None req-d386c0fe-ed88-451d-9df6-84f8f542c909 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 10, "id": "d2", "name": "ds1G"}} {{(pid=103110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:25:10.856498 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: INFO nova.api.openstack.requestlog [None req-d386c0fe-ed88-451d-9df6-84f8f542c909 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076703 May 23 12:25:10.857285 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: [pid: 103110|app: 0|req: 6/11] 10.222.0.16 () {64 vars in 1282 bytes} [Mon May 23 12:25:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 12:25:10.870259 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi [None req-b0a77955-3881-4ab3-96c4-9d842522c0a9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:25:10.894232 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: INFO nova.api.openstack.requestlog [None req-b0a77955-3881-4ab3-96c4-9d842522c0a9 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027711 May 23 12:25:10.895113 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: [pid: 103109|app: 0|req: 6/12] 10.222.0.16 () {64 vars in 1335 bytes} [Mon May 23 12:25:10 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:25:13.186861 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi [None req-d386c0fe-ed88-451d-9df6-84f8f542c909 admin admin] Calling method '>' {{(pid=103110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:25:13.187876 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: INFO nova.api.openstack.requestlog [None req-d386c0fe-ed88-451d-9df6-84f8f542c909 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001966 May 23 12:25:13.188314 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: [pid: 103110|app: 0|req: 7/13] 10.222.0.16 () {54 vars in 930 bytes} [Mon May 23 12:25:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:25:13.273007 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi [None req-6bee2ff0-9461-4942-a4ed-b5e17e8912df admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "swap": 0, "vcpus": 2, "os-flavor-access:is_public": true, "name": "ds2G", "rxtx_factor": 1.0, "ram": 2048, "id": "d3"}} {{(pid=103109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:25:13.294116 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: INFO nova.api.openstack.requestlog [None req-6bee2ff0-9461-4942-a4ed-b5e17e8912df admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.099605 May 23 12:25:13.294582 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: [pid: 103109|app: 0|req: 7/14] 10.222.0.16 () {64 vars in 1282 bytes} [Mon May 23 12:25:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 12:25:13.308029 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi [None req-7d663b23-1194-4657-884f-6b0e1352aec1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:25:13.333554 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: INFO nova.api.openstack.requestlog [None req-7d663b23-1194-4657-884f-6b0e1352aec1 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029591 May 23 12:25:13.334283 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: [pid: 103110|app: 0|req: 8/15] 10.222.0.16 () {64 vars in 1335 bytes} [Mon May 23 12:25:13 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:25:15.622631 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi [None req-6bee2ff0-9461-4942-a4ed-b5e17e8912df admin admin] Calling method '>' {{(pid=103109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:25:15.623661 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: INFO nova.api.openstack.requestlog [None req-6bee2ff0-9461-4942-a4ed-b5e17e8912df admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 May 23 12:25:15.624103 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: [pid: 103109|app: 0|req: 8/16] 10.222.0.16 () {54 vars in 930 bytes} [Mon May 23 12:25:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:25:15.686998 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi [None req-27e27820-8ba9-4522-a268-4a52e517ab89 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d4", "os-flavor-access:is_public": true, "name": "ds4G", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "disk": 20, "rxtx_factor": 1.0}} {{(pid=103110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:25:15.706500 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: INFO nova.api.openstack.requestlog [None req-27e27820-8ba9-4522-a268-4a52e517ab89 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076130 May 23 12:25:15.712589 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: [pid: 103110|app: 0|req: 9/17] 10.222.0.16 () {64 vars in 1282 bytes} [Mon May 23 12:25:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 12:25:15.718855 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi [None req-66cdb670-d923-411d-8005-783e9a809d8b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:25:15.743390 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: INFO nova.api.openstack.requestlog [None req-66cdb670-d923-411d-8005-783e9a809d8b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028357 May 23 12:25:15.744158 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: [pid: 103109|app: 0|req: 9/18] 10.222.0.16 () {64 vars in 1335 bytes} [Mon May 23 12:25:15 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:25:18.036422 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi [None req-27e27820-8ba9-4522-a268-4a52e517ab89 admin admin] Calling method '>' {{(pid=103110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:25:18.037435 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: INFO nova.api.openstack.requestlog [None req-27e27820-8ba9-4522-a268-4a52e517ab89 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 May 23 12:25:18.037826 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: [pid: 103110|app: 0|req: 10/19] 10.222.0.16 () {54 vars in 930 bytes} [Mon May 23 12:25:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:25:18.098502 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi [None req-6de1ea30-52d3-47e9-93f8-be619adba7d0 admin admin] Calling method '>' {{(pid=103109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:25:18.121939 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: INFO nova.api.openstack.requestlog [None req-6de1ea30-52d3-47e9-93f8-be619adba7d0 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.078038 May 23 12:25:18.122464 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: [pid: 103109|app: 0|req: 10/20] 10.222.0.16 () {60 vars in 1291 bytes} [Mon May 23 12:25:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:25:20.436784 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi [None req-27e27820-8ba9-4522-a268-4a52e517ab89 admin admin] Calling method '>' {{(pid=103110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:25:20.437878 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: INFO nova.api.openstack.requestlog [None req-27e27820-8ba9-4522-a268-4a52e517ab89 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002083 May 23 12:25:20.438279 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: [pid: 103110|app: 0|req: 11/21] 10.222.0.16 () {54 vars in 930 bytes} [Mon May 23 12:25:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:25:20.495374 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi [None req-5c6666aa-5447-43f0-b85b-c6507f3af34c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "os-flavor-access:is_public": true, "name": "m1.tiny"}} {{(pid=103109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:25:20.514015 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: INFO nova.api.openstack.requestlog [None req-5c6666aa-5447-43f0-b85b-c6507f3af34c admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.069893 May 23 12:25:20.515188 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: [pid: 103109|app: 0|req: 11/22] 10.222.0.16 () {64 vars in 1282 bytes} [Mon May 23 12:25:20 2022] POST /compute/v2.1/flavors => generated 402 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 12:25:20.526729 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi [None req-9a342186-c4f6-4daf-b4be-48ac7acc7367 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:25:20.549381 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: INFO nova.api.openstack.requestlog [None req-9a342186-c4f6-4daf-b4be-48ac7acc7367 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026261 May 23 12:25:20.549942 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: [pid: 103110|app: 0|req: 12/23] 10.222.0.16 () {64 vars in 1332 bytes} [Mon May 23 12:25:20 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:25:22.790728 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi [None req-5c6666aa-5447-43f0-b85b-c6507f3af34c admin admin] Calling method '>' {{(pid=103109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:25:22.791730 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: INFO nova.api.openstack.requestlog [None req-5c6666aa-5447-43f0-b85b-c6507f3af34c admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 May 23 12:25:22.792132 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: [pid: 103109|app: 0|req: 12/24] 10.222.0.16 () {54 vars in 930 bytes} [Mon May 23 12:25:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:25:22.862942 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi [None req-8b37ada2-4d69-4ee8-9bbc-8f76b0ce7cc2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "disk": 20, "rxtx_factor": 1.0, "id": "2", "name": "m1.small", "ram": 2048}} {{(pid=103110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:25:22.881706 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: INFO nova.api.openstack.requestlog [None req-8b37ada2-4d69-4ee8-9bbc-8f76b0ce7cc2 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.082836 May 23 12:25:22.882263 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: [pid: 103110|app: 0|req: 13/25] 10.222.0.16 () {64 vars in 1282 bytes} [Mon May 23 12:25:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 12:25:22.896323 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi [None req-f8abe6e8-0b35-47ff-b6ec-601ec4b8fadd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:25:22.919360 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: INFO nova.api.openstack.requestlog [None req-f8abe6e8-0b35-47ff-b6ec-601ec4b8fadd admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026768 May 23 12:25:22.919962 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: [pid: 103109|app: 0|req: 13/26] 10.222.0.16 () {64 vars in 1332 bytes} [Mon May 23 12:25:22 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:25:25.183540 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi [None req-8b37ada2-4d69-4ee8-9bbc-8f76b0ce7cc2 admin admin] Calling method '>' {{(pid=103110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:25:25.185782 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: INFO nova.api.openstack.requestlog [None req-8b37ada2-4d69-4ee8-9bbc-8f76b0ce7cc2 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002681 May 23 12:25:25.186837 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: [pid: 103110|app: 0|req: 14/27] 10.222.0.16 () {54 vars in 930 bytes} [Mon May 23 12:25:25 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:25:25.259892 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi [None req-d00628e7-c62b-411f-8a3d-3b71c267947e admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "ram": 4096, "disk": 40, "os-flavor-access:is_public": true, "name": "m1.medium", "vcpus": 2, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:25:25.281451 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: INFO nova.api.openstack.requestlog [None req-d00628e7-c62b-411f-8a3d-3b71c267947e admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.087039 May 23 12:25:25.282221 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: [pid: 103109|app: 0|req: 14/28] 10.222.0.16 () {64 vars in 1282 bytes} [Mon May 23 12:25:25 2022] POST /compute/v2.1/flavors => generated 406 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 12:25:25.295829 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi [None req-d8b29dc0-5f11-45c8-b2f0-4c6a78bccb33 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:25:25.323859 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: INFO nova.api.openstack.requestlog [None req-d8b29dc0-5f11-45c8-b2f0-4c6a78bccb33 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033258 May 23 12:25:25.324752 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: [pid: 103110|app: 0|req: 15/29] 10.222.0.16 () {64 vars in 1332 bytes} [Mon May 23 12:25:25 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:25:27.618263 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi [None req-d00628e7-c62b-411f-8a3d-3b71c267947e admin admin] Calling method '>' {{(pid=103109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:25:27.619374 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: INFO nova.api.openstack.requestlog [None req-d00628e7-c62b-411f-8a3d-3b71c267947e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001574 May 23 12:25:27.619885 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: [pid: 103109|app: 0|req: 15/30] 10.222.0.16 () {54 vars in 930 bytes} [Mon May 23 12:25:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:25:27.680023 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi [None req-75027727-61c5-41ed-96b4-fa8cf8155fe9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "ram": 8192, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "disk": 80, "vcpus": 4}} {{(pid=103110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:25:27.697892 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: INFO nova.api.openstack.requestlog [None req-75027727-61c5-41ed-96b4-fa8cf8155fe9 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071718 May 23 12:25:27.698436 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: [pid: 103110|app: 0|req: 16/31] 10.222.0.16 () {64 vars in 1282 bytes} [Mon May 23 12:25:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 12:25:27.710906 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi [None req-929429d8-3e4f-4078-8788-d0f5b3d6e373 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:25:27.735279 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: INFO nova.api.openstack.requestlog [None req-929429d8-3e4f-4078-8788-d0f5b3d6e373 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027953 May 23 12:25:27.735853 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: [pid: 103109|app: 0|req: 16/32] 10.222.0.16 () {64 vars in 1332 bytes} [Mon May 23 12:25:27 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:25:30.033160 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi [None req-75027727-61c5-41ed-96b4-fa8cf8155fe9 admin admin] Calling method '>' {{(pid=103110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:25:30.034752 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: INFO nova.api.openstack.requestlog [None req-75027727-61c5-41ed-96b4-fa8cf8155fe9 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002025 May 23 12:25:30.035157 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: [pid: 103110|app: 0|req: 17/33] 10.222.0.16 () {54 vars in 930 bytes} [Mon May 23 12:25:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:25:30.095914 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi [None req-b8a079d3-933b-4f04-8ef3-7fa246bedd1b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "rxtx_factor": 1.0, "id": "5", "ram": 16384, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 160, "vcpus": 8}} {{(pid=103109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:25:30.115851 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: INFO nova.api.openstack.requestlog [None req-b8a079d3-933b-4f04-8ef3-7fa246bedd1b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.074718 May 23 12:25:30.120308 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: [pid: 103109|app: 0|req: 17/34] 10.222.0.16 () {64 vars in 1282 bytes} [Mon May 23 12:25:30 2022] POST /compute/v2.1/flavors => generated 408 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 12:25:30.129265 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi [None req-cedfefa1-f0b0-40e3-a8ef-276518374ec6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:25:30.153014 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: INFO nova.api.openstack.requestlog [None req-cedfefa1-f0b0-40e3-a8ef-276518374ec6 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027462 May 23 12:25:30.154148 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: [pid: 103110|app: 0|req: 18/35] 10.222.0.16 () {64 vars in 1332 bytes} [Mon May 23 12:25:30 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:25:55.962241 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi [None req-b8a079d3-933b-4f04-8ef3-7fa246bedd1b admin admin] Calling method '>' {{(pid=103109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:25:55.963289 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: INFO nova.api.openstack.requestlog [None req-b8a079d3-933b-4f04-8ef3-7fa246bedd1b admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 May 23 12:25:55.963691 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: [pid: 103109|app: 0|req: 18/36] 10.222.0.16 () {54 vars in 930 bytes} [Mon May 23 12:25:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:25:55.974415 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG dbcounter [-] [103110] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:25:56.024740 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi [None req-af62214f-2f80-4add-9eaf-e620a3713606 admin admin] Calling method '>' {{(pid=103110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:25:56.042828 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: INFO nova.api.openstack.requestlog [None req-af62214f-2f80-4add-9eaf-e620a3713606 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.072873 May 23 12:25:56.043360 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: [pid: 103110|app: 0|req: 19/37] 10.222.0.16 () {60 vars in 1291 bytes} [Mon May 23 12:25:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:25:57.058685 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi [None req-b8a079d3-933b-4f04-8ef3-7fa246bedd1b admin admin] Calling method '>' {{(pid=103109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:25:57.059683 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: INFO nova.api.openstack.requestlog [None req-b8a079d3-933b-4f04-8ef3-7fa246bedd1b admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 May 23 12:25:57.060246 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: [pid: 103109|app: 0|req: 19/38] 10.222.0.16 () {56 vars in 1074 bytes} [Mon May 23 12:25:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:25:57.297799 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi [None req-aec9daf8-24c6-416b-b27a-73d5635fb560 admin admin] Calling method '>' {{(pid=103110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:25:57.303520 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: INFO nova.api.openstack.wsgi [None req-aec9daf8-24c6-416b-b27a-73d5635fb560 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 23 12:25:57.307066 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi [None req-aec9daf8-24c6-416b-b27a-73d5635fb560 admin admin] Request method failure captured: May 23 12:25:57.307066 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 23 12:25:57.307066 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: Accept: application/json May 23 12:25:57.307066 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: Accept-Encoding: gzip, deflate May 23 12:25:57.307066 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: Connection: keep-alive May 23 12:25:57.307066 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: Content-Length: 0 May 23 12:25:57.307066 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: Host: 10.222.0.16 May 23 12:25:57.307066 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: Openstack-Api-Version: compute 2.90 May 23 12:25:57.307066 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: Openstack-System-Scope: None May 23 12:25:57.307066 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: User-Agent: python-novaclient May 23 12:25:57.307066 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-Auth-Token: gAAAAABii31VNtWESHFDZwa2JKBRzxIB0S5DD6kSRrY6p9sAyEc_dfoFoBMa6TQdb7bZmwuFKAiLY4U2-ScW29wuOSWMMo4f8tvcg9elP93k0dSBXO3nk51McUPluYKdVw6DfeIzNTvpQ2C11ak9828Mu1dnXFm7m89FzaEQrOq7ozj-N48jZFM May 23 12:25:57.307066 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-Domain-Id: None May 23 12:25:57.307066 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-Domain-Name: None May 23 12:25:57.307066 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-Identity-Status: Confirmed May 23 12:25:57.307066 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-Is-Admin-Project: True May 23 12:25:57.307066 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-Openstack-Nova-Api-Version: 2.90 May 23 12:25:57.307066 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-Project-Domain-Id: default May 23 12:25:57.307066 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-Project-Domain-Name: Default May 23 12:25:57.307066 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-Project-Id: c631b5a3911e4647a05ad6138d2bc618 May 23 12:25:57.307066 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-Project-Name: admin May 23 12:25:57.307066 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-Role: member,admin,reader May 23 12:25:57.307066 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-Roles: member,admin,reader May 23 12:25:57.308804 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c631b5a3911e4647a05ad6138d2bc618"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c631b5a3911e4647a05ad6138d2bc618"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c631b5a3911e4647a05ad6138d2bc618", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c631b5a3911e4647a05ad6138d2bc618"}]}] May 23 12:25:57.308804 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-Tenant: admin May 23 12:25:57.308804 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-Tenant-Id: c631b5a3911e4647a05ad6138d2bc618 May 23 12:25:57.308804 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-Tenant-Name: admin May 23 12:25:57.308804 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-User: admin May 23 12:25:57.308804 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-User-Domain-Id: default May 23 12:25:57.308804 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-User-Domain-Name: Default May 23 12:25:57.308804 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-User-Id: 89b57772ff384ce6af49426c38787139 May 23 12:25:57.308804 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-User-Name: admin May 23 12:25:57.308804 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: method: > May 23 12:25:57.308804 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: exception: Flavor 42 could not be found. May 23 12:25:57.308804 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: action_args: {'id': '42'} May 23 12:25:57.308804 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: {{(pid=103110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:25:57.308804 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:25:57.309742 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 12:25:57.309742 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 12:25:57.309742 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 12:25:57.309742 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 12:25:57.309742 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 12:25:57.309742 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 12:25:57.309742 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 12:25:57.309742 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 12:25:57.309742 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 12:25:57.309742 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:25:57.309742 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 12:25:57.309742 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 12:25:57.309742 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 23 12:25:57.309742 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi May 23 12:25:57.309742 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:25:57.309742 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi May 23 12:25:57.309742 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:25:57.309742 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:25:57.309742 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:25:57.310992 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:25:57.310992 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:25:57.310992 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:25:57.310992 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:25:57.310992 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 12:25:57.310992 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 12:25:57.310992 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 23 12:25:57.310992 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi May 23 12:25:57.310992 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:25:57.310992 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi May 23 12:25:57.310992 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:25:57.310992 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:25:57.310992 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:25:57.310992 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:25:57.310992 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:25:57.310992 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 23 12:25:57.310992 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi May 23 12:25:57.310992 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi [None req-aec9daf8-24c6-416b-b27a-73d5635fb560 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:25:57.312338 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: INFO nova.api.openstack.requestlog [None req-aec9daf8-24c6-416b-b27a-73d5635fb560 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062242 May 23 12:25:57.312338 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: [pid: 103110|app: 0|req: 20/39] 10.222.0.16 () {60 vars in 1190 bytes} [Mon May 23 12:25:57 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 23 12:25:57.318217 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi [None req-ef690c2e-dc90-4dde-a9a3-f2d441a3902d admin admin] Calling method '>' {{(pid=103109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:25:57.321380 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG dbcounter [-] [103109] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:25:57.341396 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: INFO nova.api.openstack.requestlog [None req-ef690c2e-dc90-4dde-a9a3-f2d441a3902d admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026696 May 23 12:25:57.341947 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: [pid: 103109|app: 0|req: 20/40] 10.222.0.16 () {60 vars in 1210 bytes} [Mon May 23 12:25:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:25:57.357846 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi [None req-9f11df28-b21b-4ccc-8635-7ecf301c2241 admin admin] Calling method '>' {{(pid=103110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:25:57.379842 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: INFO nova.api.openstack.requestlog [None req-9f11df28-b21b-4ccc-8635-7ecf301c2241 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025554 May 23 12:25:57.380464 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: [pid: 103110|app: 0|req: 21/41] 10.222.0.16 () {60 vars in 1210 bytes} [Mon May 23 12:25:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:25:57.389819 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi [None req-09df9706-f38e-43a2-b4f1-5f9fbadf9307 admin admin] Calling method '>' {{(pid=103109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:25:57.396737 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: INFO nova.api.openstack.wsgi [None req-09df9706-f38e-43a2-b4f1-5f9fbadf9307 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 23 12:25:57.399990 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi [None req-09df9706-f38e-43a2-b4f1-5f9fbadf9307 admin admin] Request method failure captured: May 23 12:25:57.399990 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 23 12:25:57.399990 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: Accept: application/json May 23 12:25:57.399990 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: Accept-Encoding: gzip, deflate May 23 12:25:57.399990 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: Connection: keep-alive May 23 12:25:57.399990 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: Content-Length: 0 May 23 12:25:57.399990 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: Host: 10.222.0.16 May 23 12:25:57.399990 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: Openstack-Api-Version: compute 2.90 May 23 12:25:57.399990 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: Openstack-System-Scope: None May 23 12:25:57.399990 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: User-Agent: python-novaclient May 23 12:25:57.399990 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-Auth-Token: gAAAAABii31VNtWESHFDZwa2JKBRzxIB0S5DD6kSRrY6p9sAyEc_dfoFoBMa6TQdb7bZmwuFKAiLY4U2-ScW29wuOSWMMo4f8tvcg9elP93k0dSBXO3nk51McUPluYKdVw6DfeIzNTvpQ2C11ak9828Mu1dnXFm7m89FzaEQrOq7ozj-N48jZFM May 23 12:25:57.399990 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-Domain-Id: None May 23 12:25:57.399990 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-Domain-Name: None May 23 12:25:57.399990 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-Identity-Status: Confirmed May 23 12:25:57.399990 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-Is-Admin-Project: True May 23 12:25:57.399990 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-Openstack-Nova-Api-Version: 2.90 May 23 12:25:57.399990 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-Project-Domain-Id: default May 23 12:25:57.399990 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-Project-Domain-Name: Default May 23 12:25:57.399990 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-Project-Id: c631b5a3911e4647a05ad6138d2bc618 May 23 12:25:57.399990 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-Project-Name: admin May 23 12:25:57.399990 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-Role: member,admin,reader May 23 12:25:57.399990 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-Roles: member,admin,reader May 23 12:25:57.401566 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c631b5a3911e4647a05ad6138d2bc618"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c631b5a3911e4647a05ad6138d2bc618"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c631b5a3911e4647a05ad6138d2bc618", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c631b5a3911e4647a05ad6138d2bc618"}]}] May 23 12:25:57.401566 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-Tenant: admin May 23 12:25:57.401566 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-Tenant-Id: c631b5a3911e4647a05ad6138d2bc618 May 23 12:25:57.401566 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-Tenant-Name: admin May 23 12:25:57.401566 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-User: admin May 23 12:25:57.401566 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-User-Domain-Id: default May 23 12:25:57.401566 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-User-Domain-Name: Default May 23 12:25:57.401566 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-User-Id: 89b57772ff384ce6af49426c38787139 May 23 12:25:57.401566 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-User-Name: admin May 23 12:25:57.401566 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: method: > May 23 12:25:57.401566 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: exception: Flavor 42 could not be found. May 23 12:25:57.401566 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: action_args: {'id': '42'} May 23 12:25:57.401566 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: {{(pid=103109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:25:57.401566 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:25:57.402566 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 12:25:57.402566 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 12:25:57.402566 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 12:25:57.402566 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 12:25:57.402566 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 12:25:57.402566 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 12:25:57.402566 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 12:25:57.402566 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 12:25:57.402566 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 12:25:57.402566 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:25:57.402566 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 12:25:57.402566 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 12:25:57.402566 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 23 12:25:57.402566 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi May 23 12:25:57.402566 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:25:57.402566 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi May 23 12:25:57.402566 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:25:57.402566 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:25:57.402566 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:25:57.403834 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:25:57.403834 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:25:57.403834 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:25:57.403834 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:25:57.403834 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 12:25:57.403834 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 12:25:57.403834 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 23 12:25:57.403834 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi May 23 12:25:57.403834 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:25:57.403834 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi May 23 12:25:57.403834 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:25:57.403834 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:25:57.403834 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:25:57.403834 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:25:57.403834 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:25:57.403834 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 23 12:25:57.403834 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi May 23 12:25:57.403834 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi [None req-09df9706-f38e-43a2-b4f1-5f9fbadf9307 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103109) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:25:57.405737 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: INFO nova.api.openstack.requestlog [None req-09df9706-f38e-43a2-b4f1-5f9fbadf9307 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015256 May 23 12:25:57.405737 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: [pid: 103109|app: 0|req: 21/42] 10.222.0.16 () {60 vars in 1190 bytes} [Mon May 23 12:25:57 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 23 12:25:58.280723 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi [None req-9f11df28-b21b-4ccc-8635-7ecf301c2241 admin admin] Calling method '>' {{(pid=103110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:25:58.281926 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: INFO nova.api.openstack.requestlog [None req-9f11df28-b21b-4ccc-8635-7ecf301c2241 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002238 May 23 12:25:58.282325 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: [pid: 103110|app: 0|req: 22/43] 10.222.0.16 () {56 vars in 1074 bytes} [Mon May 23 12:25:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:25:58.475637 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi [None req-583cbf68-508b-4dee-88c2-e27b1a0dfee0 admin admin] Calling method '>' {{(pid=103109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:25:58.481676 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: INFO nova.api.openstack.wsgi [None req-583cbf68-508b-4dee-88c2-e27b1a0dfee0 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 23 12:25:58.483243 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi [None req-583cbf68-508b-4dee-88c2-e27b1a0dfee0 admin admin] Request method failure captured: May 23 12:25:58.483243 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 23 12:25:58.483243 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: Accept: application/json May 23 12:25:58.483243 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: Accept-Encoding: gzip, deflate May 23 12:25:58.483243 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: Connection: keep-alive May 23 12:25:58.483243 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: Content-Length: 0 May 23 12:25:58.483243 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: Host: 10.222.0.16 May 23 12:25:58.483243 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: Openstack-Api-Version: compute 2.90 May 23 12:25:58.483243 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: Openstack-System-Scope: None May 23 12:25:58.483243 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: User-Agent: python-novaclient May 23 12:25:58.483243 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-Auth-Token: gAAAAABii31WB1lWcD_rxJzQun9iAcIEsB7bfA3KRzRm-pd1kPgu_f5xSmHyO7RMqnVS_2zhnPdHeeuhUNItHZJk1X5gwIMwLS00dlQ6H6eVxpY80J3cBEyP4x2NGCFu0vaHvD_nEiUteGrhtpDsrOyYaGVJ9k3an2ux9A3XWjONQE0B-zAlIzw May 23 12:25:58.483243 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-Domain-Id: None May 23 12:25:58.483243 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-Domain-Name: None May 23 12:25:58.483243 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-Identity-Status: Confirmed May 23 12:25:58.483243 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-Is-Admin-Project: True May 23 12:25:58.483243 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-Openstack-Nova-Api-Version: 2.90 May 23 12:25:58.483243 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-Project-Domain-Id: default May 23 12:25:58.483243 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-Project-Domain-Name: Default May 23 12:25:58.483243 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-Project-Id: c631b5a3911e4647a05ad6138d2bc618 May 23 12:25:58.483243 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-Project-Name: admin May 23 12:25:58.483243 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-Role: member,admin,reader May 23 12:25:58.483243 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-Roles: member,admin,reader May 23 12:25:58.484872 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c631b5a3911e4647a05ad6138d2bc618"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c631b5a3911e4647a05ad6138d2bc618"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c631b5a3911e4647a05ad6138d2bc618", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c631b5a3911e4647a05ad6138d2bc618"}]}] May 23 12:25:58.484872 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-Tenant: admin May 23 12:25:58.484872 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-Tenant-Id: c631b5a3911e4647a05ad6138d2bc618 May 23 12:25:58.484872 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-Tenant-Name: admin May 23 12:25:58.484872 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-User: admin May 23 12:25:58.484872 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-User-Domain-Id: default May 23 12:25:58.484872 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-User-Domain-Name: Default May 23 12:25:58.484872 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-User-Id: 89b57772ff384ce6af49426c38787139 May 23 12:25:58.484872 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-User-Name: admin May 23 12:25:58.484872 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: method: > May 23 12:25:58.484872 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: exception: Flavor 84 could not be found. May 23 12:25:58.484872 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: action_args: {'id': '84'} May 23 12:25:58.484872 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: {{(pid=103109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:25:58.484872 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:25:58.486885 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 12:25:58.486885 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 12:25:58.486885 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 12:25:58.486885 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 12:25:58.486885 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 12:25:58.486885 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 12:25:58.486885 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 12:25:58.486885 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 12:25:58.486885 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 12:25:58.486885 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:25:58.486885 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 12:25:58.486885 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 12:25:58.486885 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 23 12:25:58.486885 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi May 23 12:25:58.486885 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:25:58.486885 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi May 23 12:25:58.486885 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:25:58.486885 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:25:58.486885 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:25:58.488192 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:25:58.488192 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:25:58.488192 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:25:58.488192 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:25:58.488192 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 12:25:58.488192 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 12:25:58.488192 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 23 12:25:58.488192 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi May 23 12:25:58.488192 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:25:58.488192 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi May 23 12:25:58.488192 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:25:58.488192 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:25:58.488192 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:25:58.488192 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:25:58.488192 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:25:58.488192 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 23 12:25:58.488192 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi May 23 12:25:58.488192 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi [None req-583cbf68-508b-4dee-88c2-e27b1a0dfee0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103109) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:25:58.489525 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: INFO nova.api.openstack.requestlog [None req-583cbf68-508b-4dee-88c2-e27b1a0dfee0 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.065420 May 23 12:25:58.489525 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: [pid: 103109|app: 0|req: 22/44] 10.222.0.16 () {60 vars in 1190 bytes} [Mon May 23 12:25:58 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 23 12:25:58.494798 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi [None req-c2a3b066-6806-4bed-a49f-33e78038e7ae admin admin] Calling method '>' {{(pid=103110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:25:58.510625 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: INFO nova.api.openstack.requestlog [None req-c2a3b066-6806-4bed-a49f-33e78038e7ae admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019377 May 23 12:25:58.511169 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: [pid: 103110|app: 0|req: 23/45] 10.222.0.16 () {60 vars in 1210 bytes} [Mon May 23 12:25:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:25:58.521158 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi [None req-a658bfce-9735-4764-990b-cd448a8dad75 admin admin] Calling method '>' {{(pid=103109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:25:58.535830 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: INFO nova.api.openstack.requestlog [None req-a658bfce-9735-4764-990b-cd448a8dad75 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018079 May 23 12:25:58.536480 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: [pid: 103109|app: 0|req: 23/46] 10.222.0.16 () {60 vars in 1210 bytes} [Mon May 23 12:25:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:25:58.546556 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi [None req-adfda913-63f5-4e4f-ac7d-1e01933402b2 admin admin] Calling method '>' {{(pid=103110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:25:58.552027 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: INFO nova.api.openstack.wsgi [None req-adfda913-63f5-4e4f-ac7d-1e01933402b2 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 23 12:25:58.553562 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi [None req-adfda913-63f5-4e4f-ac7d-1e01933402b2 admin admin] Request method failure captured: May 23 12:25:58.553562 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 23 12:25:58.553562 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: Accept: application/json May 23 12:25:58.553562 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: Accept-Encoding: gzip, deflate May 23 12:25:58.553562 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: Connection: keep-alive May 23 12:25:58.553562 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: Content-Length: 0 May 23 12:25:58.553562 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: Host: 10.222.0.16 May 23 12:25:58.553562 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: Openstack-Api-Version: compute 2.90 May 23 12:25:58.553562 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: Openstack-System-Scope: None May 23 12:25:58.553562 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: User-Agent: python-novaclient May 23 12:25:58.553562 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-Auth-Token: gAAAAABii31WB1lWcD_rxJzQun9iAcIEsB7bfA3KRzRm-pd1kPgu_f5xSmHyO7RMqnVS_2zhnPdHeeuhUNItHZJk1X5gwIMwLS00dlQ6H6eVxpY80J3cBEyP4x2NGCFu0vaHvD_nEiUteGrhtpDsrOyYaGVJ9k3an2ux9A3XWjONQE0B-zAlIzw May 23 12:25:58.553562 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-Domain-Id: None May 23 12:25:58.553562 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-Domain-Name: None May 23 12:25:58.553562 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-Identity-Status: Confirmed May 23 12:25:58.553562 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-Is-Admin-Project: True May 23 12:25:58.553562 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-Openstack-Nova-Api-Version: 2.90 May 23 12:25:58.553562 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-Project-Domain-Id: default May 23 12:25:58.553562 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-Project-Domain-Name: Default May 23 12:25:58.553562 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-Project-Id: c631b5a3911e4647a05ad6138d2bc618 May 23 12:25:58.553562 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-Project-Name: admin May 23 12:25:58.553562 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-Role: member,admin,reader May 23 12:25:58.553562 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-Roles: member,admin,reader May 23 12:25:58.554901 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c631b5a3911e4647a05ad6138d2bc618"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c631b5a3911e4647a05ad6138d2bc618"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c631b5a3911e4647a05ad6138d2bc618", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c631b5a3911e4647a05ad6138d2bc618"}]}] May 23 12:25:58.554901 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-Tenant: admin May 23 12:25:58.554901 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-Tenant-Id: c631b5a3911e4647a05ad6138d2bc618 May 23 12:25:58.554901 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-Tenant-Name: admin May 23 12:25:58.554901 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-User: admin May 23 12:25:58.554901 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-User-Domain-Id: default May 23 12:25:58.554901 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-User-Domain-Name: Default May 23 12:25:58.554901 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-User-Id: 89b57772ff384ce6af49426c38787139 May 23 12:25:58.554901 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-User-Name: admin May 23 12:25:58.554901 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: method: > May 23 12:25:58.554901 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: exception: Flavor 84 could not be found. May 23 12:25:58.554901 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: action_args: {'id': '84'} May 23 12:25:58.554901 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: {{(pid=103110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:25:58.554901 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:25:58.555831 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 12:25:58.555831 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 12:25:58.555831 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 12:25:58.555831 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 12:25:58.555831 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 12:25:58.555831 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 12:25:58.555831 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 12:25:58.555831 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 12:25:58.555831 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 12:25:58.555831 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:25:58.555831 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 12:25:58.555831 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 12:25:58.555831 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 23 12:25:58.555831 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi May 23 12:25:58.555831 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:25:58.555831 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi May 23 12:25:58.555831 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:25:58.555831 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:25:58.555831 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:25:58.557206 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:25:58.557206 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:25:58.557206 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:25:58.557206 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:25:58.557206 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 12:25:58.557206 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 12:25:58.557206 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 23 12:25:58.557206 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi May 23 12:25:58.557206 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:25:58.557206 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi May 23 12:25:58.557206 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:25:58.557206 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:25:58.557206 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:25:58.557206 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:25:58.557206 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:25:58.557206 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 23 12:25:58.557206 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi May 23 12:25:58.557206 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi [None req-adfda913-63f5-4e4f-ac7d-1e01933402b2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:25:58.558580 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: INFO nova.api.openstack.requestlog [None req-adfda913-63f5-4e4f-ac7d-1e01933402b2 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012499 May 23 12:25:58.558580 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: [pid: 103110|app: 0|req: 24/47] 10.222.0.16 () {60 vars in 1190 bytes} [Mon May 23 12:25:58 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 23 12:25:59.439155 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi [None req-a658bfce-9735-4764-990b-cd448a8dad75 admin admin] Calling method '>' {{(pid=103109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:25:59.440195 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: INFO nova.api.openstack.requestlog [None req-a658bfce-9735-4764-990b-cd448a8dad75 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002985 May 23 12:25:59.440602 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: [pid: 103109|app: 0|req: 24/48] 10.222.0.16 () {56 vars in 1074 bytes} [Mon May 23 12:25:59 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:25:59.629632 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi [None req-28a461a3-eabb-49f7-84b4-e1dbc60646db admin admin] Calling method '>' {{(pid=103110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:25:59.635424 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: INFO nova.api.openstack.wsgi [None req-28a461a3-eabb-49f7-84b4-e1dbc60646db admin admin] HTTP exception thrown: Flavor 451 could not be found. May 23 12:25:59.636961 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi [None req-28a461a3-eabb-49f7-84b4-e1dbc60646db admin admin] Request method failure captured: May 23 12:25:59.636961 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 23 12:25:59.636961 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: Accept: application/json May 23 12:25:59.636961 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: Accept-Encoding: gzip, deflate May 23 12:25:59.636961 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: Connection: keep-alive May 23 12:25:59.636961 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: Content-Length: 0 May 23 12:25:59.636961 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: Host: 10.222.0.16 May 23 12:25:59.636961 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: Openstack-Api-Version: compute 2.90 May 23 12:25:59.636961 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: Openstack-System-Scope: None May 23 12:25:59.636961 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: User-Agent: python-novaclient May 23 12:25:59.636961 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-Auth-Token: gAAAAABii31XTd0R1kCJ2deYTFNadHIl0dpxA_1vLzLPKAlyvFeLIbZaeBh4BvJPTnTNa7fWALabuwps4QNJ897K_Gi5hO9MBzSI_aNDG9Co0SY7nwH4DNfExHfxuGg8LomnGxyeYN-y4Jn9kOu2vKo0Vz9ffdDLY4xKzz_1BxGn6kKXFupPYHU May 23 12:25:59.636961 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-Domain-Id: None May 23 12:25:59.636961 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-Domain-Name: None May 23 12:25:59.636961 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-Identity-Status: Confirmed May 23 12:25:59.636961 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-Is-Admin-Project: True May 23 12:25:59.636961 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-Openstack-Nova-Api-Version: 2.90 May 23 12:25:59.636961 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-Project-Domain-Id: default May 23 12:25:59.636961 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-Project-Domain-Name: Default May 23 12:25:59.636961 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-Project-Id: c631b5a3911e4647a05ad6138d2bc618 May 23 12:25:59.636961 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-Project-Name: admin May 23 12:25:59.636961 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-Role: member,admin,reader May 23 12:25:59.636961 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-Roles: member,admin,reader May 23 12:25:59.638532 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c631b5a3911e4647a05ad6138d2bc618"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c631b5a3911e4647a05ad6138d2bc618"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c631b5a3911e4647a05ad6138d2bc618", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c631b5a3911e4647a05ad6138d2bc618"}]}] May 23 12:25:59.638532 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-Tenant: admin May 23 12:25:59.638532 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-Tenant-Id: c631b5a3911e4647a05ad6138d2bc618 May 23 12:25:59.638532 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-Tenant-Name: admin May 23 12:25:59.638532 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-User: admin May 23 12:25:59.638532 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-User-Domain-Id: default May 23 12:25:59.638532 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-User-Domain-Name: Default May 23 12:25:59.638532 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-User-Id: 89b57772ff384ce6af49426c38787139 May 23 12:25:59.638532 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: X-User-Name: admin May 23 12:25:59.638532 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: method: > May 23 12:25:59.638532 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: exception: Flavor 451 could not be found. May 23 12:25:59.638532 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: action_args: {'id': '451'} May 23 12:25:59.638532 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: {{(pid=103110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:25:59.638532 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:25:59.639840 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 12:25:59.639840 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 12:25:59.639840 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 12:25:59.639840 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 12:25:59.639840 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 12:25:59.639840 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 12:25:59.639840 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 12:25:59.639840 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 12:25:59.639840 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 12:25:59.639840 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:25:59.639840 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 12:25:59.639840 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 12:25:59.639840 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 23 12:25:59.639840 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi May 23 12:25:59.639840 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:25:59.639840 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi May 23 12:25:59.639840 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:25:59.639840 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:25:59.639840 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:25:59.641096 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:25:59.641096 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:25:59.641096 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:25:59.641096 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:25:59.641096 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 12:25:59.641096 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 12:25:59.641096 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 23 12:25:59.641096 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi May 23 12:25:59.641096 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:25:59.641096 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi May 23 12:25:59.641096 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:25:59.641096 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:25:59.641096 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:25:59.641096 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:25:59.641096 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:25:59.641096 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 23 12:25:59.641096 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: ERROR nova.api.openstack.wsgi May 23 12:25:59.641096 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi [None req-28a461a3-eabb-49f7-84b4-e1dbc60646db admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:25:59.642477 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: INFO nova.api.openstack.requestlog [None req-28a461a3-eabb-49f7-84b4-e1dbc60646db admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060524 May 23 12:25:59.642477 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: [pid: 103110|app: 0|req: 25/49] 10.222.0.16 () {60 vars in 1193 bytes} [Mon May 23 12:25:59 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 23 12:25:59.648360 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi [None req-cc19a505-0e95-40e8-881b-92ae50d73ce8 admin admin] Calling method '>' {{(pid=103109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:25:59.664357 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: INFO nova.api.openstack.requestlog [None req-cc19a505-0e95-40e8-881b-92ae50d73ce8 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019533 May 23 12:25:59.664893 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: [pid: 103109|app: 0|req: 25/50] 10.222.0.16 () {60 vars in 1210 bytes} [Mon May 23 12:25:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:25:59.675237 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi [None req-e7e0fb81-d566-4c7b-8a33-eefee9b16b16 admin admin] Calling method '>' {{(pid=103110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:25:59.691089 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: INFO nova.api.openstack.requestlog [None req-e7e0fb81-d566-4c7b-8a33-eefee9b16b16 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019399 May 23 12:25:59.691637 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: [pid: 103110|app: 0|req: 26/51] 10.222.0.16 () {60 vars in 1210 bytes} [Mon May 23 12:25:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:25:59.701325 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi [None req-97987a20-d771-4f6a-8ace-54b156bdf665 admin admin] Calling method '>' {{(pid=103109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:25:59.706735 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: INFO nova.api.openstack.wsgi [None req-97987a20-d771-4f6a-8ace-54b156bdf665 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 23 12:25:59.708255 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi [None req-97987a20-d771-4f6a-8ace-54b156bdf665 admin admin] Request method failure captured: May 23 12:25:59.708255 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 23 12:25:59.708255 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: Accept: application/json May 23 12:25:59.708255 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: Accept-Encoding: gzip, deflate May 23 12:25:59.708255 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: Connection: keep-alive May 23 12:25:59.708255 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: Content-Length: 0 May 23 12:25:59.708255 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: Host: 10.222.0.16 May 23 12:25:59.708255 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: Openstack-Api-Version: compute 2.90 May 23 12:25:59.708255 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: Openstack-System-Scope: None May 23 12:25:59.708255 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: User-Agent: python-novaclient May 23 12:25:59.708255 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-Auth-Token: gAAAAABii31XTd0R1kCJ2deYTFNadHIl0dpxA_1vLzLPKAlyvFeLIbZaeBh4BvJPTnTNa7fWALabuwps4QNJ897K_Gi5hO9MBzSI_aNDG9Co0SY7nwH4DNfExHfxuGg8LomnGxyeYN-y4Jn9kOu2vKo0Vz9ffdDLY4xKzz_1BxGn6kKXFupPYHU May 23 12:25:59.708255 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-Domain-Id: None May 23 12:25:59.708255 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-Domain-Name: None May 23 12:25:59.708255 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-Identity-Status: Confirmed May 23 12:25:59.708255 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-Is-Admin-Project: True May 23 12:25:59.708255 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-Openstack-Nova-Api-Version: 2.90 May 23 12:25:59.708255 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-Project-Domain-Id: default May 23 12:25:59.708255 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-Project-Domain-Name: Default May 23 12:25:59.708255 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-Project-Id: c631b5a3911e4647a05ad6138d2bc618 May 23 12:25:59.708255 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-Project-Name: admin May 23 12:25:59.708255 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-Role: member,admin,reader May 23 12:25:59.708255 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-Roles: member,admin,reader May 23 12:25:59.709887 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c631b5a3911e4647a05ad6138d2bc618"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c631b5a3911e4647a05ad6138d2bc618"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c631b5a3911e4647a05ad6138d2bc618", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c631b5a3911e4647a05ad6138d2bc618"}]}] May 23 12:25:59.709887 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-Tenant: admin May 23 12:25:59.709887 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-Tenant-Id: c631b5a3911e4647a05ad6138d2bc618 May 23 12:25:59.709887 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-Tenant-Name: admin May 23 12:25:59.709887 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-User: admin May 23 12:25:59.709887 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-User-Domain-Id: default May 23 12:25:59.709887 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-User-Domain-Name: Default May 23 12:25:59.709887 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-User-Id: 89b57772ff384ce6af49426c38787139 May 23 12:25:59.709887 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: X-User-Name: admin May 23 12:25:59.709887 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: method: > May 23 12:25:59.709887 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: exception: Flavor 451 could not be found. May 23 12:25:59.709887 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: action_args: {'id': '451'} May 23 12:25:59.709887 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: {{(pid=103109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:25:59.709887 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:25:59.710848 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 12:25:59.710848 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 12:25:59.710848 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 12:25:59.710848 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 12:25:59.710848 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 12:25:59.710848 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 12:25:59.710848 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 12:25:59.710848 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 12:25:59.710848 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 12:25:59.710848 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:25:59.710848 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 12:25:59.710848 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 12:25:59.710848 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 23 12:25:59.710848 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi May 23 12:25:59.710848 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:25:59.710848 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi May 23 12:25:59.710848 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:25:59.710848 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:25:59.710848 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:25:59.712269 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:25:59.712269 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:25:59.712269 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:25:59.712269 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:25:59.712269 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 12:25:59.712269 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 12:25:59.712269 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 23 12:25:59.712269 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi May 23 12:25:59.712269 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:25:59.712269 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi May 23 12:25:59.712269 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:25:59.712269 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:25:59.712269 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:25:59.712269 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:25:59.712269 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:25:59.712269 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 23 12:25:59.712269 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: ERROR nova.api.openstack.wsgi May 23 12:25:59.712269 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi [None req-97987a20-d771-4f6a-8ace-54b156bdf665 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103109) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:25:59.713521 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: INFO nova.api.openstack.requestlog [None req-97987a20-d771-4f6a-8ace-54b156bdf665 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011848 May 23 12:25:59.713521 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: [pid: 103109|app: 0|req: 26/52] 10.222.0.16 () {60 vars in 1193 bytes} [Mon May 23 12:25:59 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 23 12:26:00.597872 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi [None req-e7e0fb81-d566-4c7b-8a33-eefee9b16b16 admin admin] Calling method '>' {{(pid=103110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:26:00.598906 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: INFO nova.api.openstack.requestlog [None req-e7e0fb81-d566-4c7b-8a33-eefee9b16b16 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 May 23 12:26:00.599295 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: [pid: 103110|app: 0|req: 27/53] 10.222.0.16 () {56 vars in 1074 bytes} [Mon May 23 12:26:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:26:00.801813 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi [None req-93911046-9a85-417d-b749-d61ce64ce785 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:26:00.820240 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: INFO nova.api.openstack.requestlog [None req-93911046-9a85-417d-b749-d61ce64ce785 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.076833 May 23 12:26:00.820978 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: [pid: 103109|app: 0|req: 27/54] 10.222.0.16 () {64 vars in 1235 bytes} [Mon May 23 12:26:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 12:26:01.715343 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi [None req-e7e0fb81-d566-4c7b-8a33-eefee9b16b16 admin admin] Calling method '>' {{(pid=103110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:26:01.716430 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: INFO nova.api.openstack.requestlog [None req-e7e0fb81-d566-4c7b-8a33-eefee9b16b16 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 May 23 12:26:01.716824 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: [pid: 103110|app: 0|req: 28/55] 10.222.0.16 () {56 vars in 1074 bytes} [Mon May 23 12:26:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:26:01.911000 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi [None req-96c7274d-7b07-461d-91e5-38f7cf6fba83 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:26:01.928778 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: INFO nova.api.openstack.requestlog [None req-96c7274d-7b07-461d-91e5-38f7cf6fba83 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.070290 May 23 12:26:01.929246 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: [pid: 103109|app: 0|req: 28/56] 10.222.0.16 () {64 vars in 1235 bytes} [Mon May 23 12:26:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 12:26:02.816966 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi [None req-e7e0fb81-d566-4c7b-8a33-eefee9b16b16 admin admin] Calling method '>' {{(pid=103110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:26:02.817966 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: INFO nova.api.openstack.requestlog [None req-e7e0fb81-d566-4c7b-8a33-eefee9b16b16 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 May 23 12:26:02.818359 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: [pid: 103110|app: 0|req: 29/57] 10.222.0.16 () {56 vars in 1074 bytes} [Mon May 23 12:26:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:26:03.007721 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi [None req-d14b7dc5-8750-42e0-86c9-c583a9f89267 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:26:03.028386 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: INFO nova.api.openstack.requestlog [None req-d14b7dc5-8750-42e0-86c9-c583a9f89267 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.072383 May 23 12:26:03.029223 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: [pid: 103109|app: 0|req: 29/58] 10.222.0.16 () {64 vars in 1235 bytes} [Mon May 23 12:26:02 2022] POST /compute/v2.1/flavors => generated 407 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 12:26:03.916049 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi [None req-e7e0fb81-d566-4c7b-8a33-eefee9b16b16 admin admin] Calling method '>' {{(pid=103110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:26:03.916928 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: INFO nova.api.openstack.requestlog [None req-e7e0fb81-d566-4c7b-8a33-eefee9b16b16 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 May 23 12:26:03.917322 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: [pid: 103110|app: 0|req: 30/59] 10.222.0.16 () {56 vars in 1074 bytes} [Mon May 23 12:26:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:26:04.110115 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi [None req-0828f518-b7bd-43fd-b7cd-32e74583bf9a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:26:04.129161 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: INFO nova.api.openstack.requestlog [None req-0828f518-b7bd-43fd-b7cd-32e74583bf9a admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.074064 May 23 12:26:04.129628 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: [pid: 103109|app: 0|req: 30/60] 10.222.0.16 () {64 vars in 1235 bytes} [Mon May 23 12:26:04 2022] POST /compute/v2.1/flavors => generated 409 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 12:26:05.019580 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi [None req-e7e0fb81-d566-4c7b-8a33-eefee9b16b16 admin admin] Calling method '>' {{(pid=103110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:26:05.020631 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: INFO nova.api.openstack.requestlog [None req-e7e0fb81-d566-4c7b-8a33-eefee9b16b16 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 May 23 12:26:05.021034 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: [pid: 103110|app: 0|req: 31/61] 10.222.0.16 () {56 vars in 1074 bytes} [Mon May 23 12:26:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:26:05.212279 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi [None req-99fa1b2c-43bc-457a-84b7-49a5b01f8a07 admin admin] Calling method '>' {{(pid=103109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:26:05.232342 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: INFO nova.api.openstack.requestlog [None req-99fa1b2c-43bc-457a-84b7-49a5b01f8a07 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.073071 May 23 12:26:05.232737 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: [pid: 103109|app: 0|req: 31/62] 10.222.0.16 () {60 vars in 1202 bytes} [Mon May 23 12:26:05 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:27:09.288911 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi [None req-e7e0fb81-d566-4c7b-8a33-eefee9b16b16 admin admin] Calling method '>' {{(pid=103110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:27:09.289838 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: INFO nova.api.openstack.requestlog [None req-e7e0fb81-d566-4c7b-8a33-eefee9b16b16 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 May 23 12:27:09.290241 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: [pid: 103110|app: 0|req: 32/63] 10.222.0.16 () {54 vars in 930 bytes} [Mon May 23 12:27:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:27:09.297717 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG dbcounter [-] [103109] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:27:09.351435 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi [None req-6dd6ff57-b4d5-4022-8801-d3913abc3f2c admin admin] Calling method '>' {{(pid=103109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:27:09.372007 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: INFO nova.api.openstack.requestlog [None req-6dd6ff57-b4d5-4022-8801-d3913abc3f2c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.075724 May 23 12:27:09.372563 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: [pid: 103109|app: 0|req: 32/64] 10.222.0.16 () {60 vars in 1291 bytes} [Mon May 23 12:27:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:27:09.394323 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG dbcounter [-] [103110] Writing DB stats nova_api:SELECT=14 {{(pid=103110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:27:09.398044 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi [None req-1a4f62fd-70ef-4123-91bc-b565c4151b20 admin admin] Calling method '>' {{(pid=103110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:27:09.405537 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: INFO nova.api.openstack.requestlog [None req-1a4f62fd-70ef-4123-91bc-b565c4151b20 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013188 May 23 12:27:09.406064 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: [pid: 103110|app: 0|req: 33/65] 10.222.0.16 () {60 vars in 1282 bytes} [Mon May 23 12:27:09 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:27:09.417751 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi [None req-89ec5084-13e1-4e73-be58-e64ac8953ce5 admin admin] Calling method '>' {{(pid=103109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:27:09.426202 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: INFO nova.api.openstack.requestlog [None req-89ec5084-13e1-4e73-be58-e64ac8953ce5 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012085 May 23 12:27:09.426742 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: [pid: 103109|app: 0|req: 33/66] 10.222.0.16 () {60 vars in 1285 bytes} [Mon May 23 12:27:09 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:27:09.438072 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi [None req-6bc751de-b8f8-4ca7-b777-a3825cb9936f admin admin] Calling method '>' {{(pid=103110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:27:09.446717 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: INFO nova.api.openstack.requestlog [None req-6bc751de-b8f8-4ca7-b777-a3825cb9936f admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011963 May 23 12:27:09.447247 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: [pid: 103110|app: 0|req: 34/67] 10.222.0.16 () {60 vars in 1285 bytes} [Mon May 23 12:27:09 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:27:09.461017 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi [None req-6f439222-9fea-428f-bb19-42fe994feeb2 admin admin] Calling method '>' {{(pid=103109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:27:09.468642 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: INFO nova.api.openstack.requestlog [None req-6f439222-9fea-428f-bb19-42fe994feeb2 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011274 May 23 12:27:09.469157 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: [pid: 103109|app: 0|req: 34/68] 10.222.0.16 () {60 vars in 1282 bytes} [Mon May 23 12:27:09 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:30:58.792492 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi [None req-6bc751de-b8f8-4ca7-b777-a3825cb9936f admin admin] Calling method '>' {{(pid=103110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:30:58.794047 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: INFO nova.api.openstack.requestlog [None req-6bc751de-b8f8-4ca7-b777-a3825cb9936f admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 May 23 12:30:58.794443 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: [pid: 103110|app: 0|req: 35/69] 10.222.0.16 () {56 vars in 1074 bytes} [Mon May 23 12:30:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:30:58.954875 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG dbcounter [-] [103109] Writing DB stats nova_api:SELECT=6 {{(pid=103109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:30:59.094373 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi [None req-cd64e4ed-76f8-422b-9ee4-749582048dab admin admin] Calling method '>' {{(pid=103109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:30:59.095835 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 12:30:59.095835 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: warnings.warn(msg) May 23 12:30:59.097306 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG oslo_concurrency.lockutils [None req-cd64e4ed-76f8-422b-9ee4-749582048dab admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:30:59.097837 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG oslo_concurrency.lockutils [None req-cd64e4ed-76f8-422b-9ee4-749582048dab admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:30:59.098722 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG oslo_concurrency.lockutils [None req-cd64e4ed-76f8-422b-9ee4-749582048dab admin admin] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:30:59.099213 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG oslo_concurrency.lockutils [None req-cd64e4ed-76f8-422b-9ee4-749582048dab admin admin] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:30:59.141894 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: INFO nova.api.openstack.requestlog [None req-cd64e4ed-76f8-422b-9ee4-749582048dab admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.188137 May 23 12:30:59.142679 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: [pid: 103109|app: 0|req: 35/70] 10.222.0.16 () {60 vars in 1193 bytes} [Mon May 23 12:30:58 2022] GET /compute/v2.1/os-services => generated 794 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 12:31:00.046784 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi [None req-6bc751de-b8f8-4ca7-b777-a3825cb9936f admin admin] Calling method '>' {{(pid=103110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:31:00.048564 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: INFO nova.api.openstack.requestlog [None req-6bc751de-b8f8-4ca7-b777-a3825cb9936f admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002588 May 23 12:31:00.049236 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: [pid: 103110|app: 0|req: 36/71] 10.222.0.16 () {56 vars in 1074 bytes} [Mon May 23 12:31:00 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:31:00.249583 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi [None req-ddfd674a-09e0-4126-86b2-8c9f807964d4 admin admin] Calling method '>' {{(pid=103109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:31:00.250888 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 12:31:00.250888 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: warnings.warn(msg) May 23 12:31:00.252130 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG oslo_concurrency.lockutils [None req-ddfd674a-09e0-4126-86b2-8c9f807964d4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:31:00.252596 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG oslo_concurrency.lockutils [None req-ddfd674a-09e0-4126-86b2-8c9f807964d4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:31:00.253378 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG oslo_concurrency.lockutils [None req-ddfd674a-09e0-4126-86b2-8c9f807964d4 admin admin] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:31:00.253802 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG oslo_concurrency.lockutils [None req-ddfd674a-09e0-4126-86b2-8c9f807964d4 admin admin] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:31:00.275932 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: INFO nova.api.openstack.requestlog [None req-ddfd674a-09e0-4126-86b2-8c9f807964d4 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.084398 May 23 12:31:00.276544 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: [pid: 103109|app: 0|req: 36/72] 10.222.0.16 () {60 vars in 1193 bytes} [Mon May 23 12:31:00 2022] GET /compute/v2.1/os-services => generated 794 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 12:31:11.633135 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi [None req-6bc751de-b8f8-4ca7-b777-a3825cb9936f admin admin] Calling method '>' {{(pid=103110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:31:11.634134 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: INFO nova.api.openstack.requestlog [None req-6bc751de-b8f8-4ca7-b777-a3825cb9936f admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 May 23 12:31:11.634527 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: [pid: 103110|app: 0|req: 37/73] 10.222.0.16 () {56 vars in 1074 bytes} [Mon May 23 12:31:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:31:11.780873 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG dbcounter [-] [103109] Writing DB stats nova_cell0:SELECT=4 {{(pid=103109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:31:11.781584 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG dbcounter [-] [103109] Writing DB stats nova_cell1:SELECT=4 {{(pid=103109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:31:11.782137 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG dbcounter [-] [103109] Writing DB stats nova_api:SELECT=8 {{(pid=103109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:31:11.831957 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi [None req-5960b61b-3d96-4731-96e8-4ccbdf289c03 admin admin] Calling method '>' {{(pid=103109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:31:11.833249 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 12:31:11.833249 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: warnings.warn(msg) May 23 12:31:11.834817 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG oslo_concurrency.lockutils [None req-5960b61b-3d96-4731-96e8-4ccbdf289c03 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:31:11.835377 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG oslo_concurrency.lockutils [None req-5960b61b-3d96-4731-96e8-4ccbdf289c03 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:31:11.836340 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG oslo_concurrency.lockutils [None req-5960b61b-3d96-4731-96e8-4ccbdf289c03 admin admin] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:31:11.836898 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG oslo_concurrency.lockutils [None req-5960b61b-3d96-4731-96e8-4ccbdf289c03 admin admin] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:31:11.869520 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: INFO nova.api.openstack.requestlog [None req-5960b61b-3d96-4731-96e8-4ccbdf289c03 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.093662 May 23 12:31:11.870082 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: [pid: 103109|app: 0|req: 37/74] 10.222.0.16 () {60 vars in 1193 bytes} [Mon May 23 12:31:11 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:31:12.775187 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: DEBUG nova.api.openstack.wsgi [None req-6bc751de-b8f8-4ca7-b777-a3825cb9936f admin admin] Calling method '>' {{(pid=103110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:31:12.776252 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: INFO nova.api.openstack.requestlog [None req-6bc751de-b8f8-4ca7-b777-a3825cb9936f admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 May 23 12:31:12.776635 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: [pid: 103110|app: 0|req: 38/75] 10.222.0.16 () {56 vars in 1074 bytes} [Mon May 23 12:31:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:31:12.970468 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG nova.api.openstack.wsgi [None req-7443affb-a8e3-41da-8c00-90829f4cc6ff admin admin] Calling method '>' {{(pid=103109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:31:12.971675 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 12:31:12.971675 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: warnings.warn(msg) May 23 12:31:12.972876 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG oslo_concurrency.lockutils [None req-7443affb-a8e3-41da-8c00-90829f4cc6ff admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:31:12.973311 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG oslo_concurrency.lockutils [None req-7443affb-a8e3-41da-8c00-90829f4cc6ff admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:31:12.974079 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG oslo_concurrency.lockutils [None req-7443affb-a8e3-41da-8c00-90829f4cc6ff admin admin] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:31:12.974495 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: DEBUG oslo_concurrency.lockutils [None req-7443affb-a8e3-41da-8c00-90829f4cc6ff admin admin] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:31:12.998136 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: INFO nova.api.openstack.requestlog [None req-7443affb-a8e3-41da-8c00-90829f4cc6ff admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.081171 May 23 12:31:12.998628 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: [pid: 103109|app: 0|req: 38/76] 10.222.0.16 () {60 vars in 1193 bytes} [Mon May 23 12:31:12 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:32:14.250874 dv-cinder-836996-27-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 23 12:32:14.251431 dv-cinder-836996-27-iscsi devstack@n-api.service[103108]: Mon May 23 12:32:14 2022 - graceful shutdown triggered... May 23 12:32:14.251879 dv-cinder-836996-27-iscsi devstack@n-api.service[103109]: Gracefully killing worker 1 (pid: 103109)... May 23 12:32:14.252266 dv-cinder-836996-27-iscsi devstack@n-api.service[103110]: Gracefully killing worker 2 (pid: 103110)... May 23 12:32:15.252304 dv-cinder-836996-27-iscsi devstack@n-api.service[103108]: worker 1 buried after 1 seconds May 23 12:32:15.252304 dv-cinder-836996-27-iscsi devstack@n-api.service[103108]: worker 2 buried after 1 seconds May 23 12:32:15.252304 dv-cinder-836996-27-iscsi devstack@n-api.service[103108]: goodbye to uWSGI. May 23 12:32:15.254215 dv-cinder-836996-27-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 23 12:32:15.254779 dv-cinder-836996-27-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 23 12:32:15.257504 dv-cinder-836996-27-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 23 12:32:15.272188 dv-cinder-836996-27-iscsi devstack@n-api.service[124181]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 23 12:32:15.288655 dv-cinder-836996-27-iscsi devstack@n-api.service[124181]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 23 12:32:15 2022] *** May 23 12:32:15.288655 dv-cinder-836996-27-iscsi devstack@n-api.service[124181]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 23 12:32:15.288655 dv-cinder-836996-27-iscsi devstack@n-api.service[124181]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 23 12:32:15.288655 dv-cinder-836996-27-iscsi devstack@n-api.service[124181]: nodename: dv-cinder-836996-27-iscsi May 23 12:32:15.288655 dv-cinder-836996-27-iscsi devstack@n-api.service[124181]: machine: x86_64 May 23 12:32:15.288655 dv-cinder-836996-27-iscsi devstack@n-api.service[124181]: clock source: unix May 23 12:32:15.288655 dv-cinder-836996-27-iscsi devstack@n-api.service[124181]: pcre jit disabled May 23 12:32:15.288655 dv-cinder-836996-27-iscsi devstack@n-api.service[124181]: detected number of CPU cores: 4 May 23 12:32:15.288655 dv-cinder-836996-27-iscsi devstack@n-api.service[124181]: current working directory: / May 23 12:32:15.288655 dv-cinder-836996-27-iscsi devstack@n-api.service[124181]: detected binary path: /usr/bin/uwsgi-core May 23 12:32:15.288655 dv-cinder-836996-27-iscsi devstack@n-api.service[124181]: your processes number limit is 47680 May 23 12:32:15.288655 dv-cinder-836996-27-iscsi devstack@n-api.service[124181]: your memory page size is 4096 bytes May 23 12:32:15.288655 dv-cinder-836996-27-iscsi devstack@n-api.service[124181]: detected max file descriptor number: 2048 May 23 12:32:15.288655 dv-cinder-836996-27-iscsi devstack@n-api.service[124181]: lock engine: pthread robust mutexes May 23 12:32:15.289761 dv-cinder-836996-27-iscsi devstack@n-api.service[124181]: thunder lock: enabled May 23 12:32:15.289761 dv-cinder-836996-27-iscsi devstack@n-api.service[124181]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 23 12:32:15.289761 dv-cinder-836996-27-iscsi devstack@n-api.service[124181]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 23 12:32:15.335933 dv-cinder-836996-27-iscsi devstack@n-api.service[124181]: Python main interpreter initialized at 0x55937ba599c0 May 23 12:32:15.335933 dv-cinder-836996-27-iscsi devstack@n-api.service[124181]: python threads support enabled May 23 12:32:15.335933 dv-cinder-836996-27-iscsi devstack@n-api.service[124181]: your server socket listen backlog is limited to 100 connections May 23 12:32:15.335933 dv-cinder-836996-27-iscsi devstack@n-api.service[124181]: your mercy for graceful operations on workers is 90 seconds May 23 12:32:15.336493 dv-cinder-836996-27-iscsi devstack@n-api.service[124181]: mapped 403077 bytes (393 KB) for 2 cores May 23 12:32:15.336493 dv-cinder-836996-27-iscsi devstack@n-api.service[124181]: *** Operational MODE: preforking *** May 23 12:32:15.336649 dv-cinder-836996-27-iscsi devstack@n-api.service[124181]: *** uWSGI is running in multiple interpreter mode *** May 23 12:32:15.336649 dv-cinder-836996-27-iscsi devstack@n-api.service[124181]: spawned uWSGI master process (pid: 124181) May 23 12:32:15.336866 dv-cinder-836996-27-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 23 12:32:15.337734 dv-cinder-836996-27-iscsi devstack@n-api.service[124181]: spawned uWSGI worker 1 (pid: 124199, cores: 1) May 23 12:32:15.337858 dv-cinder-836996-27-iscsi devstack@n-api.service[124181]: spawned uWSGI worker 2 (pid: 124200, cores: 1) May 23 12:32:15.338039 dv-cinder-836996-27-iscsi devstack@n-api.service[124181]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 23 12:32:16.541129 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 23 12:32:16.546556 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 23 12:32:17.342231 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 12:32:17.342231 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: from cryptography.utils import int_from_bytes May 23 12:32:17.342637 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 12:32:17.342637 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: from cryptography.utils import int_from_bytes May 23 12:32:17.369937 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 12:32:17.369937 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: from cryptography.utils import int_from_bytes May 23 12:32:17.370410 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 12:32:17.370410 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: from cryptography.utils import int_from_bytes May 23 12:32:19.849138 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 12:32:19.849653 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 12:32:19.849956 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 12:32:19.850210 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 12:32:19.850481 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 12:32:19.850863 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.851194 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.851519 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.851847 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.852199 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.852518 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.852850 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.853170 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.853502 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.853779 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.854102 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.854434 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-27-iscsi {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.854760 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.855694 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.856021 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.856391 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.856705 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.857035 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.857346 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.857861 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.859183 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.859183 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.859183 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.859451 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.859671 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.859871 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.860200 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.860528 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.860850 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.861569 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.861569 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-27-iscsi {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.861873 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.862194 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.862511 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.862931 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.863311 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.863549 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.863873 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.864218 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.864547 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.864874 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.865197 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.865520 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.865852 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.866161 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.866474 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.866802 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.867114 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.867426 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.867742 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.867991 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.868341 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.868656 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.868979 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.869304 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.869561 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.869834 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.870136 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.870462 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.870830 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.871145 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.871456 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.871768 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.872079 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.872416 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.872729 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.873040 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.873362 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.873681 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.874007 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.874319 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.874836 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.875046 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.875299 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.875621 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.876097 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.876328 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.876609 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.876927 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.877249 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.877561 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.877871 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.878188 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.878509 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.878835 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.879141 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.879393 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.879698 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.880005 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.880349 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.880660 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.880969 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.881278 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.881581 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.881889 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.882196 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.882504 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.882813 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.883121 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.883427 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.883735 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.884044 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.884375 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.884696 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.885021 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.885332 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.885649 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.885959 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.886345 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.886707 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.887069 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.887383 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.887710 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.888022 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.888359 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.888684 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.888994 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.889303 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.889624 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.889929 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.890239 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.890560 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.890869 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.891178 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.891486 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.891796 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.892103 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.892439 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.892749 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.893056 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.893358 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.893679 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.894002 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.894323 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.894625 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.894933 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.895255 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.895638 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.895933 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.896307 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.896627 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.897134 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.897477 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.897801 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.898120 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.898438 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.898768 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.899086 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.899401 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.899718 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.901299 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.901299 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.901299 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.901299 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.901299 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.901695 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.902481 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.902801 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.903137 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.903461 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.903777 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.904125 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.904501 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.904825 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.905153 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.905476 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.905794 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.906113 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.906428 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.906755 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.907091 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.907405 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.907727 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.908043 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.908386 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.908702 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.909018 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.909331 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.909671 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.909993 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.910315 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.910632 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.910953 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.911269 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.911583 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.911896 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.912233 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.912548 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.912857 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.913167 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.913490 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.913797 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.914128 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.914440 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.914778 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.915088 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.915402 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.915722 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.916036 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.916445 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.916764 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.917079 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.917443 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.918529 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.918863 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.919174 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.919509 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.919819 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.920129 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.920479 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.920795 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.921111 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.921430 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.921747 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.922075 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.922393 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.922711 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.923051 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.923388 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.923699 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.924031 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.924389 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.924714 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.925026 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.925343 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.925658 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.925967 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.926274 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.926587 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.926894 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.927203 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.927513 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.927819 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.928126 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.928479 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.928792 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.929102 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.929425 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.929716 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.930067 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.930376 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.930722 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.931059 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.931382 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.931709 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.932025 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.932375 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.932694 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.933062 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.933465 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.933925 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.934257 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.934574 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.934900 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.935218 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.935548 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.935870 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.936217 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.936531 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.936853 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.937199 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.937536 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.937857 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.938183 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.938500 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.938820 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.939134 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.939450 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.939765 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.940080 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.940429 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.940746 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.941068 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.941382 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.941709 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.942024 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.942346 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.942448 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 12:32:19.942875 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 12:32:19.942972 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.942972 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.943201 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 12:32:19.943310 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.943489 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 12:32:19.943593 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.943753 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 12:32:19.943901 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.944149 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.944337 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.944505 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.944599 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.944834 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.944929 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.945158 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.945267 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.945479 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.945596 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.945790 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.945884 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.946103 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.946197 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.946417 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.946519 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.946739 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.946849 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.947002 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.947096 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.947325 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.947427 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.947652 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.947755 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-27-iscsi {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.947972 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.948080 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.948316 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.948412 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.948666 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.948766 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.948993 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.949350 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.949560 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.949704 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.949891 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.950037 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.950187 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.950339 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.950671 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.950766 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.951003 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.951106 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.951311 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.951404 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.951620 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.951712 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.951950 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.952045 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.952289 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.952402 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.952602 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.952697 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.952913 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.953008 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.953224 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.953320 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.953552 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.953649 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.953865 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.954032 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.954175 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.954269 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-27-iscsi {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.954498 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.954609 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.954825 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.954919 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.955140 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.955242 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.955460 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.955596 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.955780 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.955920 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.956096 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.956262 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.956450 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.956574 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.956769 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.956903 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.957081 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.957218 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.957397 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.957553 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.957712 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.957878 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.958024 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.958203 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.958327 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.958528 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.958653 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.958837 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.958965 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.959152 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.959280 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.959467 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.959614 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.959790 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.959938 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.960099 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.960213 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.960433 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.960537 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.960690 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.961005 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.961168 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.961333 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.961436 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.961658 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.961759 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.961986 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.962081 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.962243 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.962346 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.962499 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.962629 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.962822 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.962963 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.963148 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.963294 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.963464 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.963638 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.963804 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.963951 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.964077 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.964870 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.965017 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.965243 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.965487 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.965585 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.965688 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.965855 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.965959 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.966171 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.966321 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.966494 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.966594 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.966813 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.966921 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.967125 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.967218 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.967434 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.967526 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.967744 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.967851 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.968053 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.968314 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.968432 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.968575 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.968696 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.968800 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.969005 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.969100 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.969321 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.969414 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.969630 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.969725 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.970081 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.970199 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.970296 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.970383 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.970560 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.970654 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.970866 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.970971 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.971171 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.971273 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.971500 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.971592 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.971813 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.971905 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.972122 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.972233 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.972406 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.972501 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.972714 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.972815 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.973025 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.973131 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.973349 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.973488 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.973661 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.973756 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.973973 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.974078 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.974284 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.974377 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.974590 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.974690 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.974900 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.975001 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.975208 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.975299 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.975511 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.975610 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.975818 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.975923 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.976131 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.976262 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.976462 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.976563 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.976776 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.976900 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.977076 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.977178 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.977382 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.977480 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.977685 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.977778 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.978003 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.978143 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.978311 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.978432 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.978612 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.978733 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.978917 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.979022 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.979224 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.979326 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.979532 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.979634 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.979837 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.980060 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.980334 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.980430 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.980518 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.980754 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.980857 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.981079 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.981174 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.981389 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.981493 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.981697 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.981870 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.982008 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.982102 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.982324 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.982426 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.982627 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.982729 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.982932 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.983033 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.983249 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.983342 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.983561 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.983706 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.983865 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.983968 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.984295 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.984405 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.984495 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.984594 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.984796 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.984894 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.985100 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.985193 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.985406 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.985499 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.985717 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.985810 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.986023 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.986123 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.986335 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.986429 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.986779 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.986884 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.986972 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.987065 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.987234 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.987329 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.987540 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.987642 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.987850 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.987952 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:19.988156 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.988313 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.988484 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.988577 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.988790 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.988894 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.989095 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.989188 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.989399 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.989491 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.989724 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.989828 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.990036 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.990133 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.990341 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.990445 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.990645 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.990748 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.990948 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.991042 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.991297 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.991398 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.991607 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.991712 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.991959 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.992051 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.992294 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.992439 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.992609 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.992711 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.992934 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.993028 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.993250 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.993343 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.993564 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.993704 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.993882 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.993978 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.994189 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.994282 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.994507 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.994601 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.994818 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.994912 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.995134 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.995227 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.995441 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.996080 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.996318 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.996473 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.996686 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.996813 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.997004 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.997105 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.997338 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.997440 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.997669 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.997772 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.997992 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.998085 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.998314 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.998409 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.998632 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.998734 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.998944 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.999044 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.999258 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.999359 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.999570 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.999682 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.999881 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:19.999981 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.000225 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.000363 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.000531 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.000626 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.000846 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.000946 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.001159 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.001252 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.001475 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.001576 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.001788 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.001881 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.002099 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.002193 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.002415 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.002509 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.002729 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.002829 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.003038 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.003139 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.003355 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.003449 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.003667 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.003805 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.003974 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.004083 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.004305 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.004398 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.004616 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.004709 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.004923 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.005025 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.005227 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.005320 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.005536 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.005673 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.005864 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.005972 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.006198 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.006293 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.006519 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.006613 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.006858 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.006963 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.007172 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.007265 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.007487 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.007581 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.007804 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.007927 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.008114 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.008255 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.008450 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.008551 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.008768 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.008870 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.009084 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.009177 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.009395 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.009495 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.009724 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.009826 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.010040 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.010189 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.010352 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.010507 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.010677 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.010771 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.010985 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.011078 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.011827 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.011991 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.012151 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.012306 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.012490 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.012598 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.012807 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.012916 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.013123 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.013225 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.013438 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.013631 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.013767 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.013951 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.014084 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.014263 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.014401 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.014684 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.014858 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.015001 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.015095 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.015316 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.015417 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.015645 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.015787 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.015970 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.016072 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.016323 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.016422 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.016643 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.016746 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.016962 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.017063 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.017272 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.017371 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.017584 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.017692 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.017895 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.017988 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.018215 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.018344 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.018534 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.018668 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.018846 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.018974 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.019157 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.019280 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.019470 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.019600 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.019780 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.019911 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.020108 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.020244 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.020452 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.020572 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.020764 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.020894 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.021075 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.021205 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.021383 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.021513 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.021736 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.021869 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.022052 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.022273 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.022400 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.022514 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.022687 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.022810 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.022996 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.023133 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.023305 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.023429 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.023637 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.023809 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.023957 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.024084 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.024313 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.024439 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.024634 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.024769 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.024950 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.025085 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.025261 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.025390 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.025569 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.025690 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.025889 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.026017 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.026193 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.026321 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.026521 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.026650 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.026887 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.027023 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.027219 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.027350 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.027546 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.027680 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.027858 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.028003 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.028205 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.028345 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.028520 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.028650 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.028829 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.028959 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.029138 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.029259 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.029448 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.029578 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.030239 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.030366 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.030479 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.030599 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.030723 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.030837 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.030948 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.031083 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.031215 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.031308 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.031404 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.031492 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.031671 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.031776 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.031986 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.032079 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.032337 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.032436 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.032657 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.032758 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.032984 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.033085 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.033292 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.033387 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.033602 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.033711 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.033915 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.034022 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.034222 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.034323 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.034531 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.034625 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.034839 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.034944 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.035151 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.035245 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.035456 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.035559 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.035766 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.035879 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.036109 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.036225 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.036464 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.036571 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.036779 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.036883 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.037091 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.037192 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.037407 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.037556 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.037713 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.037834 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.038023 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.038160 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.038329 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.038425 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.038644 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.038746 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.038958 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.039053 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.039285 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.039388 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.039601 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.039699 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.039913 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.040007 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.040253 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.040377 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.040580 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.040690 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.040904 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.041007 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.041220 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.041375 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.041543 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.041660 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.041866 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.041976 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.042175 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.042276 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.042515 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.042616 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.042848 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.042996 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.043156 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.043256 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.043464 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.043558 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.043778 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.043872 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.044091 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.044220 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.044436 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.044532 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.044776 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.045007 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.045116 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.045343 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.045446 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.045666 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.045767 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.045988 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.046095 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.046308 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.046404 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.046634 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.046737 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.046948 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.047050 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.047283 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.047417 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.047581 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.047720 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.048148 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.048316 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.048445 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.048559 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.048680 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.048831 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.048934 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.049022 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.049115 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.049202 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.049442 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.049537 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.049758 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.049853 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.050074 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.050167 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.050390 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.050484 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.050702 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.050797 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.051018 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.051119 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.051343 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.051559 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.051660 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.051923 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.052027 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.052285 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.052384 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.052608 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.052707 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.052922 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.053060 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.053237 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.053339 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.053556 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.053664 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.053875 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.053978 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.054192 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.054301 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.054507 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.054610 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.054830 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.054977 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.055142 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.055236 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.055454 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.055556 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.055768 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.055873 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.056085 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.056203 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.056422 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.056515 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.056738 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.056835 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.057050 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.057145 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.057367 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.057653 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.057762 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.057972 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.058569 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.058790 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.058880 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.059101 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.059246 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.059423 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.059581 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.059735 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.059905 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.060050 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.060252 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.060377 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.060589 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.060697 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.060900 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.061005 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.061211 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.061307 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.061529 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.061624 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.061844 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.061948 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.062153 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.062258 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.062477 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.062618 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.062792 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.062889 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.063100 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.063203 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.063426 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.063572 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.063742 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.063848 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.064085 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.064325 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.064434 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.064682 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.064793 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.065005 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.065114 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.065329 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.065436 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.065646 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.065740 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.065961 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.066055 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.066270 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.066376 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.066590 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.066683 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.066899 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.066992 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.067211 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.067318 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.067523 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.067617 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.067833 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.067927 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.068138 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.068305 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.068471 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.068564 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.068785 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.068878 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.069097 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.069228 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.069404 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.069506 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.069710 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.069809 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.070014 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.070108 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.070325 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.070446 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.070634 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.070730 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.070939 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.071033 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.071244 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.071337 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.071559 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.071690 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.071865 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.071962 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.072185 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.072295 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.072500 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.072593 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.072798 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.072902 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.073105 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.073212 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.073412 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.073521 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.073791 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.073889 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.074356 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.074455 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.074709 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.074858 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.075021 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.075173 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.075335 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.075518 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.075700 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.075830 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.076028 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.076123 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.076368 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.076472 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.076682 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.076786 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.077003 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.077098 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.077317 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.077412 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.077644 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.077747 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.077961 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.078055 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.078275 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.078378 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.078584 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.078687 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.078898 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.078992 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.079207 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.079466 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.079812 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.079911 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.079998 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.080090 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.080203 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.080426 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.080535 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.080754 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.080858 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.081068 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.081170 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.081379 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.081481 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.081696 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.081837 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.081998 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.082103 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.082320 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.082422 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.082637 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.082741 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.082956 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.083062 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.083273 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.083405 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.083590 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.083694 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.083907 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.084018 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.084248 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.084359 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.084566 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.084659 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.084879 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.084981 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.085188 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.085290 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.085501 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.085594 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.085814 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.085921 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.086135 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.086240 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.086440 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.086534 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.086756 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.086864 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.087084 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.087178 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.087400 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.087743 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.087854 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.087951 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.088040 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.088124 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.088347 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.088444 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.088661 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.088785 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.088974 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.089072 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.089807 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.089992 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.090140 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.090296 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.090467 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.090617 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.090780 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.090934 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.091210 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.091307 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.091529 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.091623 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.091854 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.091963 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.092205 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.092303 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.092508 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.092615 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.092826 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.092970 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.093141 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.093244 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.093454 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.093549 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.093768 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.093875 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.094081 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.094184 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.094409 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.094510 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.094725 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.094826 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.095037 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.095131 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.095353 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.095448 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.095666 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.095762 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.095972 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.096066 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.096306 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.096418 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.096623 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.096749 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.096953 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.097071 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.097268 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.097395 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.097577 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.097708 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.097885 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.098028 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.098196 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.098346 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.098505 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.098670 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.098814 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.098993 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.099122 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.099352 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.099455 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.099726 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.099821 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.100030 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.100126 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.100363 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.100469 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.100671 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.100772 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.100978 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.101085 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.101282 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.101376 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.101587 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.101682 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.101901 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.102010 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.102210 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.102346 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.102514 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.102615 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.102821 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.102998 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.103127 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.103218 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.103430 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.103531 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.103756 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.103866 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.104090 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.104204 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.104454 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.104559 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.104782 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.104958 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.105274 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.105393 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.105590 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.105684 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.105906 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.106010 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.106235 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.106337 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.106562 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.106695 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.106888 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.106982 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.107204 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.107296 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.107523 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.107624 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.107840 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.107944 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.108158 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.108349 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.108503 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.108599 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.108818 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.108912 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.109134 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.109228 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.109444 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.109546 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.109774 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.109875 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.110101 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.110202 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.110412 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.110519 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.110737 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.110832 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.111061 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.111162 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.111389 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.111503 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.111714 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.111808 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.112034 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.112137 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.112410 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.112509 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.112732 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.112828 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.113040 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.113191 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.113359 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.113484 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.113717 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.113834 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.113979 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.114073 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.114300 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.114401 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.114609 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.114711 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.114929 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.115033 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.115244 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.115346 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.115560 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.115654 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.115869 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.115981 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.116204 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.116303 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.116529 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.116624 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.116841 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.116946 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.117174 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.117268 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.117493 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.117588 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.117820 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.117929 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.118144 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.118246 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.118454 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.118547 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.118701 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 12:32:20.118795 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.119086 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.119398 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.119709 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.120019 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.120398 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.121223 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.121553 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.121893 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.122229 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.122548 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.122894 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.123230 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.123554 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.123883 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.124233 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.124548 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.124860 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.125178 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.125490 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.125801 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.126114 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.126430 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.126738 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.127055 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.127365 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.127694 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.128005 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.128360 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.128680 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.128991 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.129302 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.129610 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.129961 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.130274 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.130613 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.130937 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.131266 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.131600 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.131918 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.132270 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.132598 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.132922 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.133244 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.133567 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.133892 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.134217 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.134539 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.134856 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.135177 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.135499 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.135820 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.136653 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.137006 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.137426 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.137761 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.138084 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.138411 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.138737 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.139061 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.139383 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.139707 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.140030 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.140407 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.140741 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.141078 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.141421 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.141749 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.142074 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.142398 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.142723 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.143091 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.143415 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.143730 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.144059 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.144408 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.144732 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.145052 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.145371 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.145693 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.146013 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.146332 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.146651 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.146980 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.147302 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.147634 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.147981 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.148333 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.148658 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.148981 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.149306 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.149840 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.150166 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.150507 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.150842 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.151174 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.151499 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.152370 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.152711 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.153030 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.153343 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.153662 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.153980 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.154293 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.154618 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.154938 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.155251 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.155580 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.155900 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.156475 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.156833 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.157158 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.157498 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.157831 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.158156 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.158469 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.158799 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.159115 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.159428 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.159752 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.160069 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.160416 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.160731 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.161051 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.161368 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.161682 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.162001 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.162314 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.162647 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.162961 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.163277 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.163587 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.163907 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.164246 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.164568 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.164880 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.165191 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.165510 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.165821 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.166139 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.166451 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.166769 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.167079 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.167422 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.168323 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.168829 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.169151 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.169468 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.169798 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.170120 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.170451 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.170775 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.171095 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.171452 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.171778 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.172354 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.172701 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.173034 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.173381 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.173719 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.174036 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.174357 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.174675 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.175007 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.175328 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.175649 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.175970 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.176314 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.176640 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.176962 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.177281 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.177606 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.177928 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.178249 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.178570 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.178890 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.179216 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.179324 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO dbcounter [None req-96724f5c-0355-4b1f-980d-8238fea0a624 None None] Registered counter for database nova_api May 23 12:32:20.179565 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.179899 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.180246 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.180567 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.180893 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.181211 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.181529 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.181844 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.182159 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.182483 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.182819 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.183368 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.183689 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.184120 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.184472 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.184804 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.185155 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.185454 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.185784 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.186115 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.186434 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.186761 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.187082 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.187418 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.187767 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.188104 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.188465 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.188779 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.189091 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.189403 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.189720 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.190046 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.190363 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.190673 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.190985 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.191300 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.191611 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.191923 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.192255 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.192566 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.192881 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.193190 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.193499 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.193830 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.194116 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.194425 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.194736 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.195052 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.195361 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.195672 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.195981 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.196316 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.196628 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.196969 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.197307 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.197651 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.197964 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.198283 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.198624 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.199724 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.200104 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.200248 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_db.sqlalchemy.engines [None req-96724f5c-0355-4b1f-980d-8238fea0a624 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124199) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 12:32:20.200517 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.200845 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.201206 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.201510 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.201829 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.202152 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.202473 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.202794 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.203111 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.203432 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.203771 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.204108 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.204449 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.204787 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.205110 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.205439 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.205766 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.206088 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.206427 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.206750 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.207070 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.207394 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.207712 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.207807 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writer thread running {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 12:32:20.208033 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.208396 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.208723 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.209061 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.209394 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.209713 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.210047 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.210383 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.210740 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.211060 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.211417 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.211751 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.212072 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.212417 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.212731 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:20.212982 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 12:32:20.266047 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.context [None req-96724f5c-0355-4b1f-980d-8238fea0a624 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1aae0ced-cc5a-42cd-a102-e511b8435b39(cell1) {{(pid=124199) load_cells /opt/stack/nova/nova/context.py:464}} May 23 12:32:20.270181 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-96724f5c-0355-4b1f-980d-8238fea0a624 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:32:20.271799 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-96724f5c-0355-4b1f-980d-8238fea0a624 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:32:20.272635 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-96724f5c-0355-4b1f-980d-8238fea0a624 None None] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:32:20.272827 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO dbcounter [None req-e74783dc-8f46-4b79-825b-65330d2e7386 None None] Registered counter for database nova_api May 23 12:32:20.274621 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-96724f5c-0355-4b1f-980d-8238fea0a624 None None] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:32:20.277617 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO dbcounter [None req-96724f5c-0355-4b1f-980d-8238fea0a624 None None] Registered counter for database nova_cell0 May 23 12:32:20.281701 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO dbcounter [None req-96724f5c-0355-4b1f-980d-8238fea0a624 None None] Registered counter for database nova_cell1 May 23 12:32:20.289342 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_db.sqlalchemy.engines [None req-96724f5c-0355-4b1f-980d-8238fea0a624 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124199) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 12:32:20.292546 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_db.sqlalchemy.engines [None req-96724f5c-0355-4b1f-980d-8238fea0a624 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124199) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 12:32:20.293308 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_db.sqlalchemy.engines [None req-e74783dc-8f46-4b79-825b-65330d2e7386 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124200) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 12:32:20.297723 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writer thread running {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 12:32:20.299007 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writer thread running {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 12:32:20.301271 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writer thread running {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 12:32:20.359158 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.context [None req-e74783dc-8f46-4b79-825b-65330d2e7386 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1aae0ced-cc5a-42cd-a102-e511b8435b39(cell1) {{(pid=124200) load_cells /opt/stack/nova/nova/context.py:464}} May 23 12:32:20.363347 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e74783dc-8f46-4b79-825b-65330d2e7386 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:32:20.365071 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e74783dc-8f46-4b79-825b-65330d2e7386 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:32:20.365890 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e74783dc-8f46-4b79-825b-65330d2e7386 None None] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:32:20.367892 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e74783dc-8f46-4b79-825b-65330d2e7386 None None] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:32:20.370170 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO dbcounter [None req-e74783dc-8f46-4b79-825b-65330d2e7386 None None] Registered counter for database nova_cell0 May 23 12:32:20.374227 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO dbcounter [None req-e74783dc-8f46-4b79-825b-65330d2e7386 None None] Registered counter for database nova_cell1 May 23 12:32:20.382505 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_db.sqlalchemy.engines [None req-e74783dc-8f46-4b79-825b-65330d2e7386 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124200) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 12:32:20.383248 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_db.sqlalchemy.engines [None req-e74783dc-8f46-4b79-825b-65330d2e7386 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124200) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 12:32:20.390171 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writer thread running {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 12:32:20.391474 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writer thread running {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 12:32:20.450765 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO dbcounter [None req-96724f5c-0355-4b1f-980d-8238fea0a624 None None] Registered counter for database nova_cell0 May 23 12:32:20.460606 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_db.sqlalchemy.engines [None req-96724f5c-0355-4b1f-980d-8238fea0a624 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124199) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 12:32:20.465807 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writer thread running {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 12:32:20.549673 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO dbcounter [None req-e74783dc-8f46-4b79-825b-65330d2e7386 None None] Registered counter for database nova_cell0 May 23 12:32:20.556937 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_db.sqlalchemy.engines [None req-e74783dc-8f46-4b79-825b-65330d2e7386 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124200) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 12:32:20.562237 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writer thread running {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 12:32:20.795046 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: WARNING keystonemiddleware.auth_token [None req-96724f5c-0355-4b1f-980d-8238fea0a624 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 12:32:20.802260 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: WARNING keystonemiddleware.auth_token [None req-96724f5c-0355-4b1f-980d-8238fea0a624 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 12:32:20.905790 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: WARNING keystonemiddleware.auth_token [None req-e74783dc-8f46-4b79-825b-65330d2e7386 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 12:32:20.913300 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: WARNING keystonemiddleware.auth_token [None req-e74783dc-8f46-4b79-825b-65330d2e7386 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 12:32:21.156235 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: WARNING keystonemiddleware.auth_token [None req-96724f5c-0355-4b1f-980d-8238fea0a624 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 12:32:21.162366 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: WARNING keystonemiddleware.auth_token [None req-96724f5c-0355-4b1f-980d-8238fea0a624 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 12:32:21.167925 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55937ba599c0 pid: 124199 (default app) May 23 12:32:21.259154 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: WARNING keystonemiddleware.auth_token [None req-e74783dc-8f46-4b79-825b-65330d2e7386 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 12:32:21.266010 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: WARNING keystonemiddleware.auth_token [None req-e74783dc-8f46-4b79-825b-65330d2e7386 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 12:32:21.271319 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55937ba599c0 pid: 124200 (default app) May 23 12:33:06.048503 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_api:SELECT=3 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:06.056521 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell0:SELECT=3 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:06.058141 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell1:SELECT=3 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:06.060412 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell0:SELECT=3 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:07.304106 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c3ad2251-7345-46a7-bd20-ed4ac8e1741c tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-696381981", "imageRef": "bb11dfa4-2977-4163-8237-78c871c8437f", "flavorRef": "452", "networks": [{"uuid": "dd68bfaf-6631-4742-baab-cd5040ec2035"}]}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:33:08.273940 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.network.neutron [None req-c3ad2251-7345-46a7-bd20-ed4ac8e1741c tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] validate_networks() for [('dd68bfaf-6631-4742-baab-cd5040ec2035', None, None, None, None, None)] {{(pid=124199) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 12:33:08.319535 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_api:SELECT=3 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:08.320690 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell0:SELECT=3 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:08.321724 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell1:SELECT=3 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:08.325162 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell0:SELECT=3 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:08.602282 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-7ba253f6-8636-4ae3-a4d1-2e5eeb21ed31 tempest-VolumesTestJSON-415325889 tempest-VolumesTestJSON-415325889-project] Calling method '.version_select at 0x7f095f1f0790>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:09.043382 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-7ba253f6-8636-4ae3-a4d1-2e5eeb21ed31 tempest-VolumesTestJSON-415325889 tempest-VolumesTestJSON-415325889-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/af6d70f2-5984-4ee4-ab2d-4fe8c901e6a6" status: 200 len: 350 microversion: 2.1 time: 0.728870 May 23 12:33:09.043972 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 1/1] 10.222.0.16 () {58 vars in 1244 bytes} [Mon May 23 12:33:08 2022] GET /compute/v2.1/os-volumes/af6d70f2-5984-4ee4-ab2d-4fe8c901e6a6 => generated 350 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:33:09.875003 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-c3ad2251-7345-46a7-bd20-ed4ac8e1741c tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Flavor limits 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 12:33:09.876407 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-c3ad2251-7345-46a7-bd20-ed4ac8e1741c tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Image limits 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 12:33:09.877466 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-c3ad2251-7345-46a7-bd20-ed4ac8e1741c tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Flavor pref 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 12:33:09.878294 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-c3ad2251-7345-46a7-bd20-ed4ac8e1741c tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Image pref 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 12:33:09.878951 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-c3ad2251-7345-46a7-bd20-ed4ac8e1741c tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 12:33:09.916911 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c3ad2251-7345-46a7-bd20-ed4ac8e1741c tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:09.917750 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c3ad2251-7345-46a7-bd20-ed4ac8e1741c tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:09.919691 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c3ad2251-7345-46a7-bd20-ed4ac8e1741c tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:09.920444 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c3ad2251-7345-46a7-bd20-ed4ac8e1741c tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:10.021009 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-c3ad2251-7345-46a7-bd20-ed4ac8e1741c tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Getting quotas for project 1f94aad6b61d49da817d70d2b91a7594. Resources: {'instances', 'cores', 'ram'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:33:10.039927 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-c3ad2251-7345-46a7-bd20-ed4ac8e1741c tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Getting quotas for user f2936fe7026046aa9c43f1b1b0cb1bfd and project 1f94aad6b61d49da817d70d2b91a7594. Resources: {'instances', 'cores', 'ram'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:33:10.071577 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c3ad2251-7345-46a7-bd20-ed4ac8e1741c tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Going to run 1 instances... {{(pid=124199) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 12:33:10.081932 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c3ad2251-7345-46a7-bd20-ed4ac8e1741c tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] [instance: cb177d8b-e293-48e0-ad13-3227f2a2e78a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb11dfa4-2977-4163-8237-78c871c8437f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124199) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 12:33:10.248650 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-9b2d54b6-fd79-411a-926e-d583e93db16b tempest-VolumesTestJSON-415325889 tempest-VolumesTestJSON-415325889-project] Calling method '.version_select at 0x7f095f0b7b80>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:10.292295 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c3ad2251-7345-46a7-bd20-ed4ac8e1741c tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.273358 May 23 12:33:10.293200 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 1/2] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 23 12:33:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 4276 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 12:33:10.317972 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-9f86613b-7be6-4b13-88ee-d13621c5fe0e tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:10.318604 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-9f86613b-7be6-4b13-88ee-d13621c5fe0e tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] [instance: cb177d8b-e293-48e0-ad13-3227f2a2e78a] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:10.410581 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-9b2d54b6-fd79-411a-926e-d583e93db16b tempest-VolumesTestJSON-415325889 tempest-VolumesTestJSON-415325889-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/919d8e74-6a6b-4aee-bba7-7fb8c74ee287" status: 200 len: 350 microversion: 2.1 time: 0.166646 May 23 12:33:10.418126 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1244 bytes} [Mon May 23 12:33:10 2022] GET /compute/v2.1/os-volumes/919d8e74-6a6b-4aee-bba7-7fb8c74ee287 => generated 350 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:33:10.516616 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9f86613b-7be6-4b13-88ee-d13621c5fe0e tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2936fe7026046aa9c43f1b1b0cb1bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f94aad6b61d49da817d70d2b91a7594', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:10.546831 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-9f86613b-7be6-4b13-88ee-d13621c5fe0e tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] 10.222.0.16 "GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a" status: 200 len: 1214 microversion: 2.1 time: 0.232635 May 23 12:33:10.556393 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:33:10 2022] GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a => generated 1214 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:33:11.564182 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-e8679a29-38a9-4bbe-965d-de77a15c3d9e tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:11.565117 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-e8679a29-38a9-4bbe-965d-de77a15c3d9e tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] [instance: cb177d8b-e293-48e0-ad13-3227f2a2e78a] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:11.809695 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-e8679a29-38a9-4bbe-965d-de77a15c3d9e tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2936fe7026046aa9c43f1b1b0cb1bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f94aad6b61d49da817d70d2b91a7594', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:11.844960 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-e8679a29-38a9-4bbe-965d-de77a15c3d9e tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] 10.222.0.16 "GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a" status: 200 len: 1214 microversion: 2.1 time: 0.284603 May 23 12:33:11.856470 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 3/5] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:33:11 2022] GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a => generated 1214 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:33:12.209181 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-8cfbe5a8-7afc-42ef-837c-dc8710336d9c tempest-VolumesTestJSON-415325889 tempest-VolumesTestJSON-415325889-project] Calling method '.version_select at 0x7f095e7b8dc0>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:12.469580 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-8cfbe5a8-7afc-42ef-837c-dc8710336d9c tempest-VolumesTestJSON-415325889 tempest-VolumesTestJSON-415325889-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/00cc5ab8-a0f1-4961-a18d-0146e63354b4" status: 200 len: 349 microversion: 2.1 time: 0.273247 May 23 12:33:12.470877 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 3/6] 10.222.0.16 () {58 vars in 1244 bytes} [Mon May 23 12:33:12 2022] GET /compute/v2.1/os-volumes/00cc5ab8-a0f1-4961-a18d-0146e63354b4 => generated 349 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:33:12.484357 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-fb162354-a1b6-4f70-bd22-979fe3a9ee43 tempest-VolumesTestJSON-415325889 tempest-VolumesTestJSON-415325889-project] Calling method '.version_select at 0x7f095f0a23a0>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:12.731610 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-fb162354-a1b6-4f70-bd22-979fe3a9ee43 tempest-VolumesTestJSON-415325889 tempest-VolumesTestJSON-415325889-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.251766 May 23 12:33:12.732733 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1133 bytes} [Mon May 23 12:33:12 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:33:12.756241 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-6ee74127-106b-47d6-970e-2751f254aa11 tempest-VolumesTestJSON-415325889 tempest-VolumesTestJSON-415325889-project] Calling method '.version_select at 0x7f095df3a940>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:12.877914 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-49fd7eeb-4342-43dc-82d6-c736c35c6ff7 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:12.878810 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-49fd7eeb-4342-43dc-82d6-c736c35c6ff7 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] [instance: cb177d8b-e293-48e0-ad13-3227f2a2e78a] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:12.892062 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-49fd7eeb-4342-43dc-82d6-c736c35c6ff7 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:12.892720 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-49fd7eeb-4342-43dc-82d6-c736c35c6ff7 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:12.894346 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-49fd7eeb-4342-43dc-82d6-c736c35c6ff7 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:12.902330 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-49fd7eeb-4342-43dc-82d6-c736c35c6ff7 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:13.018493 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-6ee74127-106b-47d6-970e-2751f254aa11 tempest-VolumesTestJSON-415325889 tempest-VolumesTestJSON-415325889-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.275622 May 23 12:33:13.020274 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1148 bytes} [Mon May 23 12:33:12 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 692 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:33:13.035256 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-66c23f44-035a-4574-92c1-6a38ae4368d4 tempest-VolumesTestJSON-415325889 tempest-VolumesTestJSON-415325889-project] Calling method '.version_select at 0x7f095df4a160>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:13.317035 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-66c23f44-035a-4574-92c1-6a38ae4368d4 tempest-VolumesTestJSON-415325889 tempest-VolumesTestJSON-415325889-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.287218 May 23 12:33:13.318731 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 5/9] 10.222.0.16 () {58 vars in 1133 bytes} [Mon May 23 12:33:13 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:33:13.334971 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-1f9de3ad-43d6-4bd4-9693-ad19addb7771 tempest-VolumesTestJSON-415325889 tempest-VolumesTestJSON-415325889-project] Calling method '.version_select at 0x7f095df4adc0>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:13.539777 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-1f9de3ad-43d6-4bd4-9693-ad19addb7771 tempest-VolumesTestJSON-415325889 tempest-VolumesTestJSON-415325889-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.212864 May 23 12:33:13.543068 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 6/10] 10.222.0.16 () {58 vars in 1166 bytes} [Mon May 23 12:33:13 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:33:13.554250 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0ae1d8d3-e3a6-47b9-8892-22fe8514d521 tempest-VolumesTestJSON-415325889 tempest-VolumesTestJSON-415325889-project] Calling method '.version_select at 0x7f095df4a820>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:13.663477 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-49fd7eeb-4342-43dc-82d6-c736c35c6ff7 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2936fe7026046aa9c43f1b1b0cb1bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f94aad6b61d49da817d70d2b91a7594', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:13.689751 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-49fd7eeb-4342-43dc-82d6-c736c35c6ff7 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] 10.222.0.16 "GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a" status: 200 len: 1218 microversion: 2.1 time: 0.820488 May 23 12:33:13.692584 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 5/11] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:33:12 2022] GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a => generated 1218 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:33:13.813055 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-0ae1d8d3-e3a6-47b9-8892-22fe8514d521 tempest-VolumesTestJSON-415325889 tempest-VolumesTestJSON-415325889-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.262527 May 23 12:33:13.813900 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 7/12] 10.222.0.16 () {58 vars in 1169 bytes} [Mon May 23 12:33:13 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 692 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:33:13.827401 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-b02ba9cd-2955-4b59-ab25-f8273754926f tempest-VolumesTestJSON-415325889 tempest-VolumesTestJSON-415325889-project] Calling method '.version_select at 0x7f095efb3e50>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:14.051438 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-b02ba9cd-2955-4b59-ab25-f8273754926f tempest-VolumesTestJSON-415325889 tempest-VolumesTestJSON-415325889-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.228451 May 23 12:33:14.051998 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 6/13] 10.222.0.16 () {58 vars in 1154 bytes} [Mon May 23 12:33:13 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:33:14.069288 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f462ae20-06c9-4f3a-b784-0aa13efbf917 tempest-VolumesTestJSON-415325889 tempest-VolumesTestJSON-415325889-project] Calling method '.version_select at 0x7f095fa013a0>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:14.245531 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f462ae20-06c9-4f3a-b784-0aa13efbf917 tempest-VolumesTestJSON-415325889 tempest-VolumesTestJSON-415325889-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.180063 May 23 12:33:14.252637 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 8/14] 10.222.0.16 () {58 vars in 1187 bytes} [Mon May 23 12:33:14 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:33:14.263592 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-91c27806-6e05-4bbd-9395-42ed55274cdc tempest-VolumesTestJSON-415325889 tempest-VolumesTestJSON-415325889-project] Calling method '.version_select at 0x7f095efe3040>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:14.429626 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-91c27806-6e05-4bbd-9395-42ed55274cdc tempest-VolumesTestJSON-415325889 tempest-VolumesTestJSON-415325889-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.175227 May 23 12:33:14.430189 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 7/15] 10.222.0.16 () {58 vars in 1154 bytes} [Mon May 23 12:33:14 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:33:14.713622 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-930e1975-b29a-4ac9-98ef-ae0477fb1eff tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:14.714244 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-930e1975-b29a-4ac9-98ef-ae0477fb1eff tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] [instance: cb177d8b-e293-48e0-ad13-3227f2a2e78a] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:14.735500 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-930e1975-b29a-4ac9-98ef-ae0477fb1eff tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:14.735966 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-930e1975-b29a-4ac9-98ef-ae0477fb1eff tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:14.736806 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-930e1975-b29a-4ac9-98ef-ae0477fb1eff tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:14.737252 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-930e1975-b29a-4ac9-98ef-ae0477fb1eff tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:15.077887 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-930e1975-b29a-4ac9-98ef-ae0477fb1eff tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2936fe7026046aa9c43f1b1b0cb1bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f94aad6b61d49da817d70d2b91a7594', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:15.104122 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-930e1975-b29a-4ac9-98ef-ae0477fb1eff tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] 10.222.0.16 "GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a" status: 200 len: 1210 microversion: 2.1 time: 0.393958 May 23 12:33:15.119572 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 9/16] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:33:14 2022] GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a => generated 1210 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:33:16.127062 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-68ab96d1-492d-4491-8aac-12a695da0f00 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:16.127664 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-68ab96d1-492d-4491-8aac-12a695da0f00 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] [instance: cb177d8b-e293-48e0-ad13-3227f2a2e78a] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:16.140329 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-68ab96d1-492d-4491-8aac-12a695da0f00 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:16.140787 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-68ab96d1-492d-4491-8aac-12a695da0f00 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:16.141593 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-68ab96d1-492d-4491-8aac-12a695da0f00 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:16.142043 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-68ab96d1-492d-4491-8aac-12a695da0f00 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:16.292257 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-68ab96d1-492d-4491-8aac-12a695da0f00 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2936fe7026046aa9c43f1b1b0cb1bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f94aad6b61d49da817d70d2b91a7594', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:16.316596 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-68ab96d1-492d-4491-8aac-12a695da0f00 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] 10.222.0.16 "GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a" status: 200 len: 1266 microversion: 2.1 time: 0.193289 May 23 12:33:16.317196 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 8/17] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:33:16 2022] GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:33:17.344327 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d334d8da-0832-4aac-8216-7c1cf8e7178d tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:17.344327 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d334d8da-0832-4aac-8216-7c1cf8e7178d tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] [instance: cb177d8b-e293-48e0-ad13-3227f2a2e78a] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:17.365221 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d334d8da-0832-4aac-8216-7c1cf8e7178d tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:17.377086 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d334d8da-0832-4aac-8216-7c1cf8e7178d tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:17.380627 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d334d8da-0832-4aac-8216-7c1cf8e7178d tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:17.386096 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d334d8da-0832-4aac-8216-7c1cf8e7178d tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:17.636420 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d334d8da-0832-4aac-8216-7c1cf8e7178d tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2936fe7026046aa9c43f1b1b0cb1bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f94aad6b61d49da817d70d2b91a7594', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:17.651648 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d334d8da-0832-4aac-8216-7c1cf8e7178d tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] 10.222.0.16 "GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a" status: 200 len: 1272 microversion: 2.1 time: 0.321034 May 23 12:33:17.653778 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 10/18] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:33:17 2022] GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a => generated 1272 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:33:18.674292 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-cf55b49e-1214-4159-8902-6d4338f90083 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:18.675078 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-cf55b49e-1214-4159-8902-6d4338f90083 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] [instance: cb177d8b-e293-48e0-ad13-3227f2a2e78a] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:18.692808 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-cf55b49e-1214-4159-8902-6d4338f90083 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:18.693387 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-cf55b49e-1214-4159-8902-6d4338f90083 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:18.695177 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-cf55b49e-1214-4159-8902-6d4338f90083 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:18.698875 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-cf55b49e-1214-4159-8902-6d4338f90083 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:19.792335 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-cf55b49e-1214-4159-8902-6d4338f90083 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2936fe7026046aa9c43f1b1b0cb1bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f94aad6b61d49da817d70d2b91a7594', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:19.804392 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-cf55b49e-1214-4159-8902-6d4338f90083 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] 10.222.0.16 "GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a" status: 200 len: 1272 microversion: 2.1 time: 1.135080 May 23 12:33:19.807680 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 9/19] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:33:18 2022] GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a => generated 1272 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:33:20.825670 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c0a2d987-fb3a-4386-8c23-c278910d0225 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:20.826311 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c0a2d987-fb3a-4386-8c23-c278910d0225 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] [instance: cb177d8b-e293-48e0-ad13-3227f2a2e78a] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:20.837954 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell0:SELECT=2 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:20.853111 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell0:SELECT=8 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:20.858141 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c0a2d987-fb3a-4386-8c23-c278910d0225 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:20.858606 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c0a2d987-fb3a-4386-8c23-c278910d0225 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:20.864415 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c0a2d987-fb3a-4386-8c23-c278910d0225 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:20.867126 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c0a2d987-fb3a-4386-8c23-c278910d0225 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:22.432857 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c0a2d987-fb3a-4386-8c23-c278910d0225 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2936fe7026046aa9c43f1b1b0cb1bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f94aad6b61d49da817d70d2b91a7594', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:22.440588 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c0a2d987-fb3a-4386-8c23-c278910d0225 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] 10.222.0.16 "GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a" status: 200 len: 1314 microversion: 2.1 time: 1.620263 May 23 12:33:22.441105 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 11/20] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:33:20 2022] GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a => generated 1314 bytes in 1622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:33:23.468101 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-9455a655-65b9-46fb-863a-0cde6b8ed5f7 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:23.469005 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-9455a655-65b9-46fb-863a-0cde6b8ed5f7 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] [instance: cb177d8b-e293-48e0-ad13-3227f2a2e78a] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:23.480479 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell0:SELECT=2 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:23.487930 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9455a655-65b9-46fb-863a-0cde6b8ed5f7 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:23.493289 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9455a655-65b9-46fb-863a-0cde6b8ed5f7 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:23.501286 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9455a655-65b9-46fb-863a-0cde6b8ed5f7 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:23.510169 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9455a655-65b9-46fb-863a-0cde6b8ed5f7 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:25.386642 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c0746d63-e8a4-43a0-9503-03b829b5eb2a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Action: 'create', calling method: .version_select at 0x7f095dec8790>, body: {"keypair": {"name": "tempest-keypair-1696254475", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOfoDA/ttnex6ygylswb9XZwCeLtGNF/M1PCI3GXPXfN2cz9jRGyMZPYphwxFcKgK0Wl3qS1/001rBG4sp781l3/9NZ0wChpI4dmD5DTbbb+OA/qo4xCgXwtwEjsgT0yfQ=="}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:33:25.450306 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-c0746d63-e8a4-43a0-9503-03b829b5eb2a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Getting quotas for project 0502b9ef01e2460893cfc855d44db0c7. Resources: {'key_pairs'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:33:25.471455 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-c0746d63-e8a4-43a0-9503-03b829b5eb2a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Getting quotas for user 851454212d14438d80bf8e193fea268e and project 0502b9ef01e2460893cfc855d44db0c7. Resources: {'key_pairs'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:33:25.569705 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c0746d63-e8a4-43a0-9503-03b829b5eb2a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.656914 May 23 12:33:25.574520 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 12/21] 10.222.0.16 () {62 vars in 1199 bytes} [Mon May 23 12:33:24 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 663 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 23 12:33:28.094054 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-9455a655-65b9-46fb-863a-0cde6b8ed5f7 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2936fe7026046aa9c43f1b1b0cb1bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f94aad6b61d49da817d70d2b91a7594', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:28.104677 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-9455a655-65b9-46fb-863a-0cde6b8ed5f7 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] 10.222.0.16 "GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a" status: 200 len: 1314 microversion: 2.1 time: 4.641225 May 23 12:33:28.118549 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 10/22] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:33:23 2022] GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a => generated 1314 bytes in 4656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:33:29.125084 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-284c0ebc-2e96-4473-9e31-7e503b0f3a46 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:29.125727 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-284c0ebc-2e96-4473-9e31-7e503b0f3a46 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] [instance: cb177d8b-e293-48e0-ad13-3227f2a2e78a] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:29.151252 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-284c0ebc-2e96-4473-9e31-7e503b0f3a46 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:29.166483 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-284c0ebc-2e96-4473-9e31-7e503b0f3a46 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:29.166483 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-284c0ebc-2e96-4473-9e31-7e503b0f3a46 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:29.166483 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-284c0ebc-2e96-4473-9e31-7e503b0f3a46 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:30.223467 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-0f987a36-713d-45bf-9ec9-c8729576e07a tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Action: 'create', calling method: .version_select at 0x7f095efe3280>, body: {"keypair": {"name": "tempest-keypair-317774095", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1mYKxT+65cmvL/cEb6pOurXpY42MNkcxTNXYb4emXZjxSR3gnNZjDQr+8pDxLqVcsmJeMi8jwxpf6IgMgPuaGQC4/C/QBJuVmydA2XQDHDUE7mGa7OOO+wQtpZi8jK4w=="}} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:33:30.456043 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.quota [None req-0f987a36-713d-45bf-9ec9-c8729576e07a tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Getting quotas for project da82f9c566664cb1a974cf0d1bf1b09d. Resources: {'key_pairs'} {{(pid=124200) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:33:30.481090 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.quota [None req-0f987a36-713d-45bf-9ec9-c8729576e07a tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Getting quotas for user ef222fe025534a9e942f8c5c4ed1e3e7 and project da82f9c566664cb1a974cf0d1bf1b09d. Resources: {'key_pairs'} {{(pid=124200) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:33:30.528534 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-284c0ebc-2e96-4473-9e31-7e503b0f3a46 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2936fe7026046aa9c43f1b1b0cb1bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f94aad6b61d49da817d70d2b91a7594', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:30.541364 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-284c0ebc-2e96-4473-9e31-7e503b0f3a46 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] 10.222.0.16 "GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a" status: 200 len: 1314 microversion: 2.1 time: 1.419664 May 23 12:33:30.541953 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 13/23] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:33:29 2022] GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a => generated 1314 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:33:30.709665 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f200dcdd-02f0-44bd-85ab-58ca3fa33fc5 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Action: 'create', calling method: .version_select at 0x7f095de7d280>, body: {"keypair": {"name": "tempest-keypair-2146788300", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0dXEB8VHV02mgHd/V9Hg1uWE9dU5SMh+LuA0U+esqVHBsLZ1B5dEZ870UjVTmnH6hfLgvVujEu/Vqw9oubv1KCdfINxao1SIDAh/DWg1RBSvkXaWdGzwnHJDvlFW0U4w=="}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:33:30.725361 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-0f987a36-713d-45bf-9ec9-c8729576e07a tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.191679 May 23 12:33:30.728665 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 11/24] 10.222.0.16 () {60 vars in 1158 bytes} [Mon May 23 12:33:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:33:30.764895 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-f200dcdd-02f0-44bd-85ab-58ca3fa33fc5 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Getting quotas for project 736376830ed340b2aa62c455c134c4e2. Resources: {'key_pairs'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:33:30.776116 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-f200dcdd-02f0-44bd-85ab-58ca3fa33fc5 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Getting quotas for user 771d3e22beff44f7bbc3103fd75a35b4 and project 736376830ed340b2aa62c455c134c4e2. Resources: {'key_pairs'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:33:30.878353 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f200dcdd-02f0-44bd-85ab-58ca3fa33fc5 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.314230 May 23 12:33:30.880358 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 14/25] 10.222.0.16 () {60 vars in 1158 bytes} [Mon May 23 12:33:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:33:31.596080 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-0a35592e-0366-49c5-9f73-1499e0451bab tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:31.601802 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-0a35592e-0366-49c5-9f73-1499e0451bab tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] [instance: cb177d8b-e293-48e0-ad13-3227f2a2e78a] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:31.639422 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0a35592e-0366-49c5-9f73-1499e0451bab tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:31.640195 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0a35592e-0366-49c5-9f73-1499e0451bab tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:31.641501 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0a35592e-0366-49c5-9f73-1499e0451bab tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:31.645650 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0a35592e-0366-49c5-9f73-1499e0451bab tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:33.463816 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-0a35592e-0366-49c5-9f73-1499e0451bab tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2936fe7026046aa9c43f1b1b0cb1bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f94aad6b61d49da817d70d2b91a7594', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:33.483338 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-0a35592e-0366-49c5-9f73-1499e0451bab tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] 10.222.0.16 "GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a" status: 200 len: 1314 microversion: 2.1 time: 1.919587 May 23 12:33:33.483992 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 12/26] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:33:31 2022] GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a => generated 1314 bytes in 1929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:33:33.873110 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-6f41133c-1c94-4d64-ac8c-ba8b42f4e07b req-05f3f30a-5b62-4232-8ba2-754d07d2f8e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb177d8b-e293-48e0-ad13-3227f2a2e78a", "tag": "c165f7a4-5ae0-43f4-b352-6a0940825a20"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:33:33.933481 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-6f41133c-1c94-4d64-ac8c-ba8b42f4e07b req-05f3f30a-5b62-4232-8ba2-754d07d2f8e8 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:33.935163 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-6f41133c-1c94-4d64-ac8c-ba8b42f4e07b req-05f3f30a-5b62-4232-8ba2-754d07d2f8e8 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:34.013641 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-6f41133c-1c94-4d64-ac8c-ba8b42f4e07b req-05f3f30a-5b62-4232-8ba2-754d07d2f8e8 service nova] Creating event network-changed:c165f7a4-5ae0-43f4-b352-6a0940825a20 for instance cb177d8b-e293-48e0-ad13-3227f2a2e78a on hv-cinder-83699 May 23 12:33:34.014296 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-6f41133c-1c94-4d64-ac8c-ba8b42f4e07b req-05f3f30a-5b62-4232-8ba2-754d07d2f8e8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124199) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 23 12:33:34.015897 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-54f18095-c2b1-4952-9f70-b1960153ae31 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:34.019586 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-54f18095-c2b1-4952-9f70-b1960153ae31 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:34.020642 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-54f18095-c2b1-4952-9f70-b1960153ae31 None None] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:34.022382 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-54f18095-c2b1-4952-9f70-b1960153ae31 None None] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:34.049241 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.compute.rpcapi [None req-54f18095-c2b1-4952-9f70-b1960153ae31 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 23 12:33:34.050471 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-54f18095-c2b1-4952-9f70-b1960153ae31 None None] Releasing lock "compute-rpcapi-router" {{(pid=124199) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 23 12:33:34.094300 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-54f18095-c2b1-4952-9f70-b1960153ae31 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.646423 May 23 12:33:34.095633 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 15/27] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:33:34.518572 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-3aa575de-34b9-4128-9fee-5c2bfd6ba04c tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:34.519844 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-3aa575de-34b9-4128-9fee-5c2bfd6ba04c tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] [instance: cb177d8b-e293-48e0-ad13-3227f2a2e78a] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:34.542024 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3aa575de-34b9-4128-9fee-5c2bfd6ba04c tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:34.544064 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3aa575de-34b9-4128-9fee-5c2bfd6ba04c tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:34.546330 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3aa575de-34b9-4128-9fee-5c2bfd6ba04c tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:34.547273 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3aa575de-34b9-4128-9fee-5c2bfd6ba04c tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:34.562389 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-67a38960-e806-4327-9d1c-6a0995c6f4a6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1015795505", "imageRef": "bb11dfa4-2977-4163-8237-78c871c8437f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3322fe8c-081c-4cfd-b180-198330997eff"}], "security_groups": [{"name": "tempest-securitygroup--1588069971"}], "key_name": "tempest-keypair-1696254475", "user_data": "}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:33:34.994704 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-3aa575de-34b9-4128-9fee-5c2bfd6ba04c tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2936fe7026046aa9c43f1b1b0cb1bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f94aad6b61d49da817d70d2b91a7594', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:35.008595 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-3aa575de-34b9-4128-9fee-5c2bfd6ba04c tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] 10.222.0.16 "GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a" status: 200 len: 1314 microversion: 2.1 time: 0.508162 May 23 12:33:35.035295 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 13/28] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:33:34 2022] GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a => generated 1314 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:33:35.558683 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.network.neutron [None req-67a38960-e806-4327-9d1c-6a0995c6f4a6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] validate_networks() for [('3322fe8c-081c-4cfd-b180-198330997eff', None, None, None, None, None)] {{(pid=124199) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 12:33:36.034585 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-5002078a-18cb-466e-ae10-e1b8f96748f0 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:36.035267 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-5002078a-18cb-466e-ae10-e1b8f96748f0 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] [instance: cb177d8b-e293-48e0-ad13-3227f2a2e78a] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:36.049548 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5002078a-18cb-466e-ae10-e1b8f96748f0 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:36.049997 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5002078a-18cb-466e-ae10-e1b8f96748f0 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:36.053643 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5002078a-18cb-466e-ae10-e1b8f96748f0 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:36.055074 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5002078a-18cb-466e-ae10-e1b8f96748f0 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:37.101306 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-5002078a-18cb-466e-ae10-e1b8f96748f0 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2936fe7026046aa9c43f1b1b0cb1bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f94aad6b61d49da817d70d2b91a7594', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:37.113791 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-5002078a-18cb-466e-ae10-e1b8f96748f0 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] 10.222.0.16 "GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a" status: 200 len: 1314 microversion: 2.1 time: 1.084218 May 23 12:33:37.116426 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 14/29] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:33:36 2022] GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a => generated 1314 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:33:37.162740 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=5 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:38.135701 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-1ab89cfe-4629-4519-8d7b-010713edbddd tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:38.138507 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-1ab89cfe-4629-4519-8d7b-010713edbddd tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] [instance: cb177d8b-e293-48e0-ad13-3227f2a2e78a] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:38.152494 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1ab89cfe-4629-4519-8d7b-010713edbddd tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:38.152939 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1ab89cfe-4629-4519-8d7b-010713edbddd tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:38.161512 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1ab89cfe-4629-4519-8d7b-010713edbddd tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:38.161967 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1ab89cfe-4629-4519-8d7b-010713edbddd tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:38.955351 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-1ab89cfe-4629-4519-8d7b-010713edbddd tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2936fe7026046aa9c43f1b1b0cb1bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f94aad6b61d49da817d70d2b91a7594', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:38.967921 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell1:SELECT=47 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:38.981253 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-67a38960-e806-4327-9d1c-6a0995c6f4a6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Flavor limits 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 12:33:38.982368 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-67a38960-e806-4327-9d1c-6a0995c6f4a6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Image limits 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 12:33:38.982592 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-1ab89cfe-4629-4519-8d7b-010713edbddd tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] 10.222.0.16 "GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a" status: 200 len: 1314 microversion: 2.1 time: 0.849187 May 23 12:33:38.983248 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-67a38960-e806-4327-9d1c-6a0995c6f4a6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Flavor pref 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 12:33:38.983682 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-67a38960-e806-4327-9d1c-6a0995c6f4a6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Image pref 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 12:33:38.984111 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-67a38960-e806-4327-9d1c-6a0995c6f4a6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 12:33:38.986372 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 15/30] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:33:38 2022] GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a => generated 1314 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:33:39.002545 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-67a38960-e806-4327-9d1c-6a0995c6f4a6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:39.003022 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-67a38960-e806-4327-9d1c-6a0995c6f4a6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:39.003842 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-67a38960-e806-4327-9d1c-6a0995c6f4a6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:39.004323 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-67a38960-e806-4327-9d1c-6a0995c6f4a6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:39.005718 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-76b0af85-5cd5-4d16-8c04-e7b8e1057831 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1607003704", "imageRef": "bb11dfa4-2977-4163-8237-78c871c8437f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cc274260-5d38-4e43-aa07-b73fcfa156ea"}], "security_groups": [{"name": "tempest-securitygroup--216958322"}], "key_name": "tempest-keypair-2146788300", "user_data": "}} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:33:39.027502 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell1:SELECT=31 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:39.050534 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-67a38960-e806-4327-9d1c-6a0995c6f4a6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Getting quotas for project 0502b9ef01e2460893cfc855d44db0c7. Resources: {'instances', 'cores', 'ram'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:33:39.055655 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-67a38960-e806-4327-9d1c-6a0995c6f4a6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Getting quotas for user 851454212d14438d80bf8e193fea268e and project 0502b9ef01e2460893cfc855d44db0c7. Resources: {'instances', 'cores', 'ram'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:33:39.058074 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:39.086411 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-67a38960-e806-4327-9d1c-6a0995c6f4a6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Going to run 1 instances... {{(pid=124199) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 12:33:39.107302 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-67a38960-e806-4327-9d1c-6a0995c6f4a6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb11dfa4-2977-4163-8237-78c871c8437f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124199) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 12:33:39.282807 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-67a38960-e806-4327-9d1c-6a0995c6f4a6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.724537 May 23 12:33:39.286632 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 16/31] 10.222.0.16 () {62 vars in 1187 bytes} [Mon May 23 12:33:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 4730 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 23 12:33:39.322067 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-bcbb949e-0ecc-4a79-85e3-c012fa3177e8 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:39.332106 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-bcbb949e-0ecc-4a79-85e3-c012fa3177e8 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:39.537110 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-bcbb949e-0ecc-4a79-85e3-c012fa3177e8 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:39.553373 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.network.neutron [None req-76b0af85-5cd5-4d16-8c04-e7b8e1057831 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] validate_networks() for [('cc274260-5d38-4e43-aa07-b73fcfa156ea', None, None, None, None, None)] {{(pid=124200) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 12:33:39.561937 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-bcbb949e-0ecc-4a79-85e3-c012fa3177e8 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:39.568286 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-bcbb949e-0ecc-4a79-85e3-c012fa3177e8 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:39.570723 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-bcbb949e-0ecc-4a79-85e3-c012fa3177e8 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1282 microversion: 2.20 time: 0.275217 May 23 12:33:39.573584 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 17/32] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:33:39 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1282 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:33:40.146185 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-478ec0a9-a3f8-42a8-a4c3-59a807655e16 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1398951146", "imageRef": "bb11dfa4-2977-4163-8237-78c871c8437f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:33:40.288746 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.network.neutron [None req-478ec0a9-a3f8-42a8-a4c3-59a807655e16 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] validate_networks() for [('4833a70f-d11d-46d6-944f-14af0b04cad3', None, None, None, None, None)] {{(pid=124199) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 12:33:40.544988 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell0:SELECT=4 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:42.130929 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-76b0af85-5cd5-4d16-8c04-e7b8e1057831 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Flavor limits 0:0:0 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 12:33:42.131544 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-76b0af85-5cd5-4d16-8c04-e7b8e1057831 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Image limits 0:0:0 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 12:33:42.131887 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-76b0af85-5cd5-4d16-8c04-e7b8e1057831 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Flavor pref 0:0:0 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 12:33:42.132250 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-76b0af85-5cd5-4d16-8c04-e7b8e1057831 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Image pref 0:0:0 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 12:33:42.132776 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-76b0af85-5cd5-4d16-8c04-e7b8e1057831 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 12:33:42.161346 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-76b0af85-5cd5-4d16-8c04-e7b8e1057831 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:42.161728 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-76b0af85-5cd5-4d16-8c04-e7b8e1057831 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:42.162544 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-76b0af85-5cd5-4d16-8c04-e7b8e1057831 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:42.163031 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-76b0af85-5cd5-4d16-8c04-e7b8e1057831 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:42.248026 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.quota [None req-76b0af85-5cd5-4d16-8c04-e7b8e1057831 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Getting quotas for project 736376830ed340b2aa62c455c134c4e2. Resources: {'instances', 'cores', 'ram'} {{(pid=124200) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:33:42.257328 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.quota [None req-76b0af85-5cd5-4d16-8c04-e7b8e1057831 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Getting quotas for user 771d3e22beff44f7bbc3103fd75a35b4 and project 736376830ed340b2aa62c455c134c4e2. Resources: {'instances', 'cores', 'ram'} {{(pid=124200) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:33:42.304752 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-76b0af85-5cd5-4d16-8c04-e7b8e1057831 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Going to run 1 instances... {{(pid=124200) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 12:33:42.319720 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-76b0af85-5cd5-4d16-8c04-e7b8e1057831 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb11dfa4-2977-4163-8237-78c871c8437f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124200) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 12:33:42.357836 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-478ec0a9-a3f8-42a8-a4c3-59a807655e16 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Flavor limits 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 12:33:42.358417 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-478ec0a9-a3f8-42a8-a4c3-59a807655e16 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Image limits 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 12:33:42.359352 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-478ec0a9-a3f8-42a8-a4c3-59a807655e16 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Flavor pref 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 12:33:42.359862 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-478ec0a9-a3f8-42a8-a4c3-59a807655e16 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Image pref 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 12:33:42.360325 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-478ec0a9-a3f8-42a8-a4c3-59a807655e16 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 12:33:42.385460 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-478ec0a9-a3f8-42a8-a4c3-59a807655e16 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:42.386889 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-478ec0a9-a3f8-42a8-a4c3-59a807655e16 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:42.391061 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-478ec0a9-a3f8-42a8-a4c3-59a807655e16 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:42.393119 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-478ec0a9-a3f8-42a8-a4c3-59a807655e16 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:42.471589 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-478ec0a9-a3f8-42a8-a4c3-59a807655e16 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Getting quotas for project dcc45b8bab17498cadda8d64b3a76780. Resources: {'instances', 'cores', 'ram'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:33:42.486245 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-478ec0a9-a3f8-42a8-a4c3-59a807655e16 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Getting quotas for user 687208d733174bffa2783e6857401f39 and project dcc45b8bab17498cadda8d64b3a76780. Resources: {'instances', 'cores', 'ram'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:33:42.553057 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-478ec0a9-a3f8-42a8-a4c3-59a807655e16 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Going to run 1 instances... {{(pid=124199) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 12:33:42.556468 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-76b0af85-5cd5-4d16-8c04-e7b8e1057831 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.563604 May 23 12:33:42.560024 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 16/33] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 23 12:33:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 3573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 12:33:42.568633 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-478ec0a9-a3f8-42a8-a4c3-59a807655e16 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb11dfa4-2977-4163-8237-78c871c8437f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124199) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 12:33:42.590348 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-e3ec5fde-bad8-42f1-b6fc-578134626f9d tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:42.590988 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-e3ec5fde-bad8-42f1-b6fc-578134626f9d tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] [instance: cb177d8b-e293-48e0-ad13-3227f2a2e78a] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:42.623773 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e3ec5fde-bad8-42f1-b6fc-578134626f9d tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:42.626679 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e3ec5fde-bad8-42f1-b6fc-578134626f9d tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:42.631511 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e3ec5fde-bad8-42f1-b6fc-578134626f9d tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:42.632340 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e3ec5fde-bad8-42f1-b6fc-578134626f9d tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:42.775629 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-478ec0a9-a3f8-42a8-a4c3-59a807655e16 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.198682 May 23 12:33:42.777626 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 18/34] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 23 12:33:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 3202 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 12:33:42.789057 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-dcf57bca-98dc-4e3f-bcca-237272b30405 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:42.792029 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-dcf57bca-98dc-4e3f-bcca-237272b30405 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:42.812291 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dcf57bca-98dc-4e3f-bcca-237272b30405 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:42.813293 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dcf57bca-98dc-4e3f-bcca-237272b30405 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:42.814528 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dcf57bca-98dc-4e3f-bcca-237272b30405 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:42.815168 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dcf57bca-98dc-4e3f-bcca-237272b30405 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:43.054420 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-dcf57bca-98dc-4e3f-bcca-237272b30405 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:43.077150 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-dcf57bca-98dc-4e3f-bcca-237272b30405 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:43.078829 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-dcf57bca-98dc-4e3f-bcca-237272b30405 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:43.085317 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-dcf57bca-98dc-4e3f-bcca-237272b30405 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1340 microversion: 2.20 time: 0.301243 May 23 12:33:43.088235 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 19/35] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:33:42 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1340 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:33:43.104974 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-a11b2e17-e2ff-44e4-b293-52938e44dc9b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1039716999", "imageRef": "bb11dfa4-2977-4163-8237-78c871c8437f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "34e447e2-b5a8-48e8-88c3-11c08d0cb74a"}], "security_groups": [{"name": "tempest-securitygroup--428445257"}], "key_name": "tempest-keypair-317774095", "user_data": "}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:33:43.269465 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-e3ec5fde-bad8-42f1-b6fc-578134626f9d tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2936fe7026046aa9c43f1b1b0cb1bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f94aad6b61d49da817d70d2b91a7594', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:43.296018 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-e3ec5fde-bad8-42f1-b6fc-578134626f9d tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] 10.222.0.16 "GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a" status: 200 len: 1314 microversion: 2.1 time: 0.729693 May 23 12:33:43.299781 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 17/36] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:33:42 2022] GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a => generated 1314 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:33:43.506518 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.network.neutron [None req-a11b2e17-e2ff-44e4-b293-52938e44dc9b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] validate_networks() for [('34e447e2-b5a8-48e8-88c3-11c08d0cb74a', None, None, None, None, None)] {{(pid=124199) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 12:33:43.833636 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-5a665676-4b6d-4f08-9491-68e82d70ad18 req-32ce8ae0-a129-45bf-b406-683f6932a40e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb177d8b-e293-48e0-ad13-3227f2a2e78a", "name": "network-vif-plugged", "status": "completed", "tag": "c165f7a4-5ae0-43f4-b352-6a0940825a20"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:33:43.896229 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-5a665676-4b6d-4f08-9491-68e82d70ad18 req-32ce8ae0-a129-45bf-b406-683f6932a40e service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:43.897458 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-5a665676-4b6d-4f08-9491-68e82d70ad18 req-32ce8ae0-a129-45bf-b406-683f6932a40e service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:43.953365 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-5a665676-4b6d-4f08-9491-68e82d70ad18 req-32ce8ae0-a129-45bf-b406-683f6932a40e service nova] Creating event network-vif-plugged:c165f7a4-5ae0-43f4-b352-6a0940825a20 for instance cb177d8b-e293-48e0-ad13-3227f2a2e78a on hv-cinder-83699 May 23 12:33:43.954988 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-5a665676-4b6d-4f08-9491-68e82d70ad18 req-32ce8ae0-a129-45bf-b406-683f6932a40e service nova] Acquired lock "compute-rpcapi-router" {{(pid=124200) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 23 12:33:43.956202 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-edce46ce-c55a-4eab-b3a3-916bcce56297 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:43.956660 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-edce46ce-c55a-4eab-b3a3-916bcce56297 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:43.957479 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-edce46ce-c55a-4eab-b3a3-916bcce56297 None None] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:43.957889 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-edce46ce-c55a-4eab-b3a3-916bcce56297 None None] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:43.969051 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.compute.rpcapi [None req-edce46ce-c55a-4eab-b3a3-916bcce56297 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 23 12:33:43.969956 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-edce46ce-c55a-4eab-b3a3-916bcce56297 None None] Releasing lock "compute-rpcapi-router" {{(pid=124200) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 23 12:33:44.006784 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-edce46ce-c55a-4eab-b3a3-916bcce56297 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.705546 May 23 12:33:44.007389 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 18/37] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:33:44.028800 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-616db1a0-1bcb-496d-acf7-ea09a5ae973e tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:44.029668 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-616db1a0-1bcb-496d-acf7-ea09a5ae973e tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:44.061041 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-616db1a0-1bcb-496d-acf7-ea09a5ae973e tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:44.064021 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-616db1a0-1bcb-496d-acf7-ea09a5ae973e tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:44.066157 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-616db1a0-1bcb-496d-acf7-ea09a5ae973e tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:44.067259 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-616db1a0-1bcb-496d-acf7-ea09a5ae973e tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:44.376430 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-616db1a0-1bcb-496d-acf7-ea09a5ae973e tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:44.394044 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-616db1a0-1bcb-496d-acf7-ea09a5ae973e tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 200 len: 1234 microversion: 2.1 time: 0.385127 May 23 12:33:44.395058 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 19/38] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:33:44 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 1234 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:33:44.419094 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-62589127-2c2b-498a-9050-21411cc84244 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:44.419720 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-62589127-2c2b-498a-9050-21411cc84244 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:44.436143 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-62589127-2c2b-498a-9050-21411cc84244 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:44.436868 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-62589127-2c2b-498a-9050-21411cc84244 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:44.437868 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-62589127-2c2b-498a-9050-21411cc84244 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:44.438452 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-62589127-2c2b-498a-9050-21411cc84244 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:44.658419 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-62589127-2c2b-498a-9050-21411cc84244 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:44.674871 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-62589127-2c2b-498a-9050-21411cc84244 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1274 microversion: 2.1 time: 0.266129 May 23 12:33:44.681624 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 20/39] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:33:44 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1274 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:33:44.703625 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-0e7a3bc0-705b-41da-bc75-004e69777eb5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:44.709830 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-0e7a3bc0-705b-41da-bc75-004e69777eb5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:44.741430 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0e7a3bc0-705b-41da-bc75-004e69777eb5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:44.742397 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0e7a3bc0-705b-41da-bc75-004e69777eb5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:44.744393 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0e7a3bc0-705b-41da-bc75-004e69777eb5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:44.745104 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0e7a3bc0-705b-41da-bc75-004e69777eb5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:45.244614 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-a11b2e17-e2ff-44e4-b293-52938e44dc9b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Flavor limits 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 12:33:45.245719 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-a11b2e17-e2ff-44e4-b293-52938e44dc9b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Image limits 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 12:33:45.246371 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-a11b2e17-e2ff-44e4-b293-52938e44dc9b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Flavor pref 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 12:33:45.247157 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-a11b2e17-e2ff-44e4-b293-52938e44dc9b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Image pref 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 12:33:45.247756 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-a11b2e17-e2ff-44e4-b293-52938e44dc9b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 12:33:45.326755 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a11b2e17-e2ff-44e4-b293-52938e44dc9b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:45.327630 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a11b2e17-e2ff-44e4-b293-52938e44dc9b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:45.330652 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a11b2e17-e2ff-44e4-b293-52938e44dc9b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:45.333647 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a11b2e17-e2ff-44e4-b293-52938e44dc9b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:45.449797 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-a11b2e17-e2ff-44e4-b293-52938e44dc9b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Getting quotas for project da82f9c566664cb1a974cf0d1bf1b09d. Resources: {'instances', 'cores', 'ram'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:33:45.461074 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-a11b2e17-e2ff-44e4-b293-52938e44dc9b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Getting quotas for user ef222fe025534a9e942f8c5c4ed1e3e7 and project da82f9c566664cb1a974cf0d1bf1b09d. Resources: {'instances', 'cores', 'ram'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:33:45.489879 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-a11b2e17-e2ff-44e4-b293-52938e44dc9b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Going to run 1 instances... {{(pid=124199) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 12:33:45.505400 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-a11b2e17-e2ff-44e4-b293-52938e44dc9b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb11dfa4-2977-4163-8237-78c871c8437f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124199) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 12:33:45.565786 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-0e7a3bc0-705b-41da-bc75-004e69777eb5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:45.580163 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-0e7a3bc0-705b-41da-bc75-004e69777eb5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:45.585789 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-0e7a3bc0-705b-41da-bc75-004e69777eb5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:45.587151 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-0e7a3bc0-705b-41da-bc75-004e69777eb5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1408 microversion: 2.20 time: 0.903556 May 23 12:33:45.587943 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 21/40] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:33:44 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1408 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:33:45.605345 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-168baafc-e784-4df0-a47e-e6f4ecce4872 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:45.606221 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-168baafc-e784-4df0-a47e-e6f4ecce4872 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] [instance: cb177d8b-e293-48e0-ad13-3227f2a2e78a] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:45.615924 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-168baafc-e784-4df0-a47e-e6f4ecce4872 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:45.616639 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-168baafc-e784-4df0-a47e-e6f4ecce4872 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:45.618858 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-168baafc-e784-4df0-a47e-e6f4ecce4872 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:45.622047 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-168baafc-e784-4df0-a47e-e6f4ecce4872 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:45.687755 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-a11b2e17-e2ff-44e4-b293-52938e44dc9b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.593679 May 23 12:33:45.705083 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 20/41] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 23 12:33:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 2608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 12:33:45.732033 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d5b8e887-400b-407d-b454-3209f9b14f01 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-458795001", "imageRef": "bb11dfa4-2977-4163-8237-78c871c8437f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:33:45.875045 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.network.neutron [None req-d5b8e887-400b-407d-b454-3209f9b14f01 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] validate_networks() for [('4833a70f-d11d-46d6-944f-14af0b04cad3', None, None, None, None, None)] {{(pid=124199) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 12:33:46.383241 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-168baafc-e784-4df0-a47e-e6f4ecce4872 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2936fe7026046aa9c43f1b1b0cb1bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f94aad6b61d49da817d70d2b91a7594', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:46.396014 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-168baafc-e784-4df0-a47e-e6f4ecce4872 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] 10.222.0.16 "GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a" status: 200 len: 1314 microversion: 2.1 time: 0.803411 May 23 12:33:46.409336 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 22/42] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:33:45 2022] GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a => generated 1314 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:33:46.410629 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-ff984471-7278-447d-9c82-ea76c19f8acf tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:46.411298 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-ff984471-7278-447d-9c82-ea76c19f8acf tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:46.427101 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ff984471-7278-447d-9c82-ea76c19f8acf tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:46.427907 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ff984471-7278-447d-9c82-ea76c19f8acf tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:46.429432 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ff984471-7278-447d-9c82-ea76c19f8acf tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:46.430187 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ff984471-7278-447d-9c82-ea76c19f8acf tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:47.050600 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-ff984471-7278-447d-9c82-ea76c19f8acf tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:47.062791 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-ff984471-7278-447d-9c82-ea76c19f8acf tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 200 len: 1296 microversion: 2.1 time: 0.660135 May 23 12:33:47.064203 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 23/43] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:33:46 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 1296 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:33:47.070782 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-39c0fedb-bdee-42a5-8cee-35007942ad14 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:47.072324 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-39c0fedb-bdee-42a5-8cee-35007942ad14 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:47.101756 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-39c0fedb-bdee-42a5-8cee-35007942ad14 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:47.105084 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-39c0fedb-bdee-42a5-8cee-35007942ad14 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:47.108482 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-39c0fedb-bdee-42a5-8cee-35007942ad14 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:47.109007 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-39c0fedb-bdee-42a5-8cee-35007942ad14 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:47.260115 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-39c0fedb-bdee-42a5-8cee-35007942ad14 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:47.275439 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-39c0fedb-bdee-42a5-8cee-35007942ad14 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5" status: 200 len: 1293 microversion: 2.1 time: 0.209336 May 23 12:33:47.279773 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 24/44] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:33:47 2022] GET /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 => generated 1293 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:33:47.294641 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-04bb8ff3-e603-4615-a0b9-a9353b81fe77 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:47.295707 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-04bb8ff3-e603-4615-a0b9-a9353b81fe77 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:47.318330 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-04bb8ff3-e603-4615-a0b9-a9353b81fe77 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:47.318954 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-04bb8ff3-e603-4615-a0b9-a9353b81fe77 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:47.322256 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-04bb8ff3-e603-4615-a0b9-a9353b81fe77 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:47.324084 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-04bb8ff3-e603-4615-a0b9-a9353b81fe77 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:47.829414 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-d5b8e887-400b-407d-b454-3209f9b14f01 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Flavor limits 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 12:33:47.829928 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-d5b8e887-400b-407d-b454-3209f9b14f01 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Image limits 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 12:33:47.830316 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-d5b8e887-400b-407d-b454-3209f9b14f01 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Flavor pref 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 12:33:47.830978 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-d5b8e887-400b-407d-b454-3209f9b14f01 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Image pref 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 12:33:47.831421 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-d5b8e887-400b-407d-b454-3209f9b14f01 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 12:33:47.855582 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d5b8e887-400b-407d-b454-3209f9b14f01 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:47.856048 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d5b8e887-400b-407d-b454-3209f9b14f01 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:47.857596 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d5b8e887-400b-407d-b454-3209f9b14f01 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:47.858099 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d5b8e887-400b-407d-b454-3209f9b14f01 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:47.887280 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-d5b8e887-400b-407d-b454-3209f9b14f01 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Getting quotas for project dcc45b8bab17498cadda8d64b3a76780. Resources: {'instances', 'cores', 'ram'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:33:47.897386 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-d5b8e887-400b-407d-b454-3209f9b14f01 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Getting quotas for user 687208d733174bffa2783e6857401f39 and project dcc45b8bab17498cadda8d64b3a76780. Resources: {'instances', 'cores', 'ram'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:33:47.946439 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d5b8e887-400b-407d-b454-3209f9b14f01 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Going to run 1 instances... {{(pid=124199) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 12:33:47.957291 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d5b8e887-400b-407d-b454-3209f9b14f01 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb11dfa4-2977-4163-8237-78c871c8437f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124199) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 12:33:47.994756 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-04bb8ff3-e603-4615-a0b9-a9353b81fe77 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:48.016696 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-04bb8ff3-e603-4615-a0b9-a9353b81fe77 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:48.037298 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-04bb8ff3-e603-4615-a0b9-a9353b81fe77 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:48.050475 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-04bb8ff3-e603-4615-a0b9-a9353b81fe77 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1408 microversion: 2.20 time: 0.767148 May 23 12:33:48.056789 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 25/45] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:33:47 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1408 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:33:48.084330 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-ef971763-807b-4bc8-91d4-4f38ad808d18 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:48.088738 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-ef971763-807b-4bc8-91d4-4f38ad808d18 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] [instance: cb177d8b-e293-48e0-ad13-3227f2a2e78a] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:48.113291 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ef971763-807b-4bc8-91d4-4f38ad808d18 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:48.119722 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d5b8e887-400b-407d-b454-3209f9b14f01 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.413097 May 23 12:33:48.121232 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 21/46] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 23 12:33:45 2022] POST /compute/v2.1/servers => generated 383 bytes in 2415 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 12:33:48.126474 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ef971763-807b-4bc8-91d4-4f38ad808d18 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:48.128690 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-4233ef4d-8205-4868-be62-f9330401767c tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:48.129478 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-4233ef4d-8205-4868-be62-f9330401767c tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:48.129751 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ef971763-807b-4bc8-91d4-4f38ad808d18 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:48.130312 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ef971763-807b-4bc8-91d4-4f38ad808d18 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:48.139353 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4233ef4d-8205-4868-be62-f9330401767c tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:48.140983 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4233ef4d-8205-4868-be62-f9330401767c tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:48.143494 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4233ef4d-8205-4868-be62-f9330401767c tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:48.149146 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4233ef4d-8205-4868-be62-f9330401767c tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:48.314717 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-4233ef4d-8205-4868-be62-f9330401767c tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:48.346813 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-4233ef4d-8205-4868-be62-f9330401767c tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 200 len: 1296 microversion: 2.1 time: 0.215910 May 23 12:33:48.347482 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 22/47] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:33:48 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 1296 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:33:48.379233 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c2095694-94ab-48c0-8004-769ec796f575 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:48.382488 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c2095694-94ab-48c0-8004-769ec796f575 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:48.662800 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c2095694-94ab-48c0-8004-769ec796f575 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:48.678424 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c2095694-94ab-48c0-8004-769ec796f575 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1221 microversion: 2.1 time: 0.321419 May 23 12:33:48.681536 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 23/48] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:33:48 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1221 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:33:48.687884 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-bb8173a0-dbbc-4765-be9a-c14339493985 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:48.691703 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-bb8173a0-dbbc-4765-be9a-c14339493985 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:48.709624 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bb8173a0-dbbc-4765-be9a-c14339493985 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:48.710469 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bb8173a0-dbbc-4765-be9a-c14339493985 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:48.711546 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bb8173a0-dbbc-4765-be9a-c14339493985 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:48.713079 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bb8173a0-dbbc-4765-be9a-c14339493985 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:48.835129 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-ef971763-807b-4bc8-91d4-4f38ad808d18 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2936fe7026046aa9c43f1b1b0cb1bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f94aad6b61d49da817d70d2b91a7594', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:48.848054 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-ef971763-807b-4bc8-91d4-4f38ad808d18 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] 10.222.0.16 "GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a" status: 200 len: 1500 microversion: 2.1 time: 0.787370 May 23 12:33:48.849768 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 26/49] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:33:48 2022] GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a => generated 1500 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:33:49.046184 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-bb8173a0-dbbc-4765-be9a-c14339493985 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:49.059681 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-bb8173a0-dbbc-4765-be9a-c14339493985 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5" status: 200 len: 1299 microversion: 2.1 time: 0.376800 May 23 12:33:49.068424 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 24/50] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:33:48 2022] GET /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 => generated 1299 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:33:49.099119 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-856068c2-90e5-4666-84bf-1ca480f6d36d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:49.099709 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-856068c2-90e5-4666-84bf-1ca480f6d36d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:49.116054 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-2d16c9b7-90de-4239-a23d-e9b960a95585 req-67f53a5c-b691-4889-927d-a7db518ed9dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce37af9c-e5f8-4233-97f3-4280a2114e45", "tag": "357ce430-3b90-4a7c-b2f3-c2ee303501e4"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:33:49.140338 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-2d16c9b7-90de-4239-a23d-e9b960a95585 req-67f53a5c-b691-4889-927d-a7db518ed9dd service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:49.140818 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-2d16c9b7-90de-4239-a23d-e9b960a95585 req-67f53a5c-b691-4889-927d-a7db518ed9dd service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:49.159720 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-856068c2-90e5-4666-84bf-1ca480f6d36d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:49.163284 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-856068c2-90e5-4666-84bf-1ca480f6d36d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:49.168039 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-856068c2-90e5-4666-84bf-1ca480f6d36d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:49.168640 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-856068c2-90e5-4666-84bf-1ca480f6d36d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:49.208351 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-2d16c9b7-90de-4239-a23d-e9b960a95585 req-67f53a5c-b691-4889-927d-a7db518ed9dd service nova] Creating event network-changed:357ce430-3b90-4a7c-b2f3-c2ee303501e4 for instance ce37af9c-e5f8-4233-97f3-4280a2114e45 on hv-cinder-83699 May 23 12:33:49.232854 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-2d16c9b7-90de-4239-a23d-e9b960a95585 req-67f53a5c-b691-4889-927d-a7db518ed9dd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115805 May 23 12:33:49.235964 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 25/51] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:33:49.365740 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c96482ba-ade4-412c-a4a9-5c6e97e75180 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:49.366502 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c96482ba-ade4-412c-a4a9-5c6e97e75180 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:49.385615 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c96482ba-ade4-412c-a4a9-5c6e97e75180 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:49.386079 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c96482ba-ade4-412c-a4a9-5c6e97e75180 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:49.386914 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c96482ba-ade4-412c-a4a9-5c6e97e75180 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:49.387379 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c96482ba-ade4-412c-a4a9-5c6e97e75180 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:49.951883 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c96482ba-ade4-412c-a4a9-5c6e97e75180 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:49.969227 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c96482ba-ade4-412c-a4a9-5c6e97e75180 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 200 len: 1363 microversion: 2.1 time: 0.605221 May 23 12:33:49.972490 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 26/52] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:33:49 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 1363 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:33:49.982696 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c5836695-f26d-46ef-9ca4-240d63ffd11a tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:49.985518 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c5836695-f26d-46ef-9ca4-240d63ffd11a tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:50.002606 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c5836695-f26d-46ef-9ca4-240d63ffd11a tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:50.003059 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c5836695-f26d-46ef-9ca4-240d63ffd11a tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:50.003849 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c5836695-f26d-46ef-9ca4-240d63ffd11a tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:50.004315 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c5836695-f26d-46ef-9ca4-240d63ffd11a tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:50.202311 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-856068c2-90e5-4666-84bf-1ca480f6d36d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:50.213297 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-856068c2-90e5-4666-84bf-1ca480f6d36d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:50.215359 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-856068c2-90e5-4666-84bf-1ca480f6d36d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:50.216826 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-856068c2-90e5-4666-84bf-1ca480f6d36d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1408 microversion: 2.20 time: 1.137129 May 23 12:33:50.228967 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 27/53] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:33:49 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1408 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:33:50.239360 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-9c69c3a5-5ca2-4449-ba18-8642aea6577f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:50.249596 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-9c69c3a5-5ca2-4449-ba18-8642aea6577f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:50.267700 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9c69c3a5-5ca2-4449-ba18-8642aea6577f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:50.268148 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9c69c3a5-5ca2-4449-ba18-8642aea6577f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:50.269040 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9c69c3a5-5ca2-4449-ba18-8642aea6577f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:50.269459 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9c69c3a5-5ca2-4449-ba18-8642aea6577f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:50.298736 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c5836695-f26d-46ef-9ca4-240d63ffd11a tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:50.316873 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c5836695-f26d-46ef-9ca4-240d63ffd11a tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1273 microversion: 2.1 time: 0.342656 May 23 12:33:50.322938 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 27/54] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:33:49 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1273 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:33:50.468476 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-9c69c3a5-5ca2-4449-ba18-8642aea6577f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:50.477241 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-9c69c3a5-5ca2-4449-ba18-8642aea6577f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5" status: 200 len: 1299 microversion: 2.1 time: 0.247031 May 23 12:33:50.478089 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 28/55] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:33:50 2022] GET /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 => generated 1299 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:33:50.824601 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-5087f229-3fbc-4faf-9d6a-783d21b82ebc req-c6c7a75f-629f-4454-8953-ebd1ce61718e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cdb78f1-4de7-4c61-82e0-abe6c742e7aa", "tag": "47e7dcef-9f40-451c-adfd-004f425d19fb"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:33:50.834126 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-5087f229-3fbc-4faf-9d6a-783d21b82ebc req-c6c7a75f-629f-4454-8953-ebd1ce61718e service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:50.834569 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-5087f229-3fbc-4faf-9d6a-783d21b82ebc req-c6c7a75f-629f-4454-8953-ebd1ce61718e service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:50.848955 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-5087f229-3fbc-4faf-9d6a-783d21b82ebc req-c6c7a75f-629f-4454-8953-ebd1ce61718e service nova] Creating event network-changed:47e7dcef-9f40-451c-adfd-004f425d19fb for instance 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa on hv-cinder-83699 May 23 12:33:50.859149 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-5087f229-3fbc-4faf-9d6a-783d21b82ebc req-c6c7a75f-629f-4454-8953-ebd1ce61718e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107727 May 23 12:33:50.859778 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 28/56] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:33:50.929401 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-2a47aa86-56b3-41a4-aa2c-a83f7eb8a872 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d040704-455f-4127-9c34-085f0ac5e352"}} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:33:50.931254 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-2a47aa86-56b3-41a4-aa2c-a83f7eb8a872 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] [instance: cb177d8b-e293-48e0-ad13-3227f2a2e78a] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:50.946289 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2a47aa86-56b3-41a4-aa2c-a83f7eb8a872 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:50.946985 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2a47aa86-56b3-41a4-aa2c-a83f7eb8a872 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:50.947996 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2a47aa86-56b3-41a4-aa2c-a83f7eb8a872 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:50.948882 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2a47aa86-56b3-41a4-aa2c-a83f7eb8a872 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:50.994325 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-ecc8c830-51f4-44bc-a706-11b25bd4fb54 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:50.999385 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-ecc8c830-51f4-44bc-a706-11b25bd4fb54 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:51.022857 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ecc8c830-51f4-44bc-a706-11b25bd4fb54 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:51.024049 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ecc8c830-51f4-44bc-a706-11b25bd4fb54 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:51.028552 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ecc8c830-51f4-44bc-a706-11b25bd4fb54 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:51.029451 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ecc8c830-51f4-44bc-a706-11b25bd4fb54 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:51.638513 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-2a47aa86-56b3-41a4-aa2c-a83f7eb8a872 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] 10.222.0.16 "POST /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.712097 May 23 12:33:51.643793 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 29/57] 10.222.0.16 () {60 vars in 1322 bytes} [Mon May 23 12:33:50 2022] POST /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a/os-volume_attachments => generated 194 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:33:51.669198 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-b7635fa1-cd92-4b2f-90f5-a780aa4ac89c tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:51.673105 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-b7635fa1-cd92-4b2f-90f5-a780aa4ac89c tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:51.973613 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-ecc8c830-51f4-44bc-a706-11b25bd4fb54 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:51.988874 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-ecc8c830-51f4-44bc-a706-11b25bd4fb54 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 200 len: 1363 microversion: 2.1 time: 1.000016 May 23 12:33:51.994851 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 29/58] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:33:50 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 1363 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:33:52.013021 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-77acd066-c671-4913-b850-d9de7fafac54 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:52.022834 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-77acd066-c671-4913-b850-d9de7fafac54 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:52.033003 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b7635fa1-cd92-4b2f-90f5-a780aa4ac89c tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:52.033421 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b7635fa1-cd92-4b2f-90f5-a780aa4ac89c tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:52.034695 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b7635fa1-cd92-4b2f-90f5-a780aa4ac89c tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:52.035435 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b7635fa1-cd92-4b2f-90f5-a780aa4ac89c tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:52.051417 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-77acd066-c671-4913-b850-d9de7fafac54 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:52.052237 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-77acd066-c671-4913-b850-d9de7fafac54 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:52.053465 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-77acd066-c671-4913-b850-d9de7fafac54 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:52.054132 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-77acd066-c671-4913-b850-d9de7fafac54 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:52.277853 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell0:SELECT=6 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:52.335007 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-77acd066-c671-4913-b850-d9de7fafac54 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:52.359481 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-77acd066-c671-4913-b850-d9de7fafac54 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1279 microversion: 2.1 time: 0.355194 May 23 12:33:52.366641 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 30/59] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:33:51 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1279 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:33:52.375162 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-71fd04ef-d99a-431b-860c-01436471e305 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:52.376113 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-71fd04ef-d99a-431b-860c-01436471e305 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:52.385937 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-71fd04ef-d99a-431b-860c-01436471e305 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:52.387044 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-71fd04ef-d99a-431b-860c-01436471e305 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:52.389747 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-71fd04ef-d99a-431b-860c-01436471e305 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:52.390685 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-71fd04ef-d99a-431b-860c-01436471e305 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:52.775965 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-b7635fa1-cd92-4b2f-90f5-a780aa4ac89c tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:52.786489 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-b7635fa1-cd92-4b2f-90f5-a780aa4ac89c tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:52.790352 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-b7635fa1-cd92-4b2f-90f5-a780aa4ac89c tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:52.792223 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-b7635fa1-cd92-4b2f-90f5-a780aa4ac89c tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1408 microversion: 2.20 time: 1.146942 May 23 12:33:52.794553 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 30/60] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:33:51 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1408 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:33:52.914274 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-71fd04ef-d99a-431b-860c-01436471e305 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:52.925609 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-71fd04ef-d99a-431b-860c-01436471e305 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5" status: 200 len: 1366 microversion: 2.1 time: 0.557538 May 23 12:33:52.926506 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 31/61] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:33:52 2022] GET /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 => generated 1366 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:33:53.007909 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-8122d82a-9087-4dec-b7d3-cf8958b3f7a3 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:53.008648 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-8122d82a-9087-4dec-b7d3-cf8958b3f7a3 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:53.018093 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8122d82a-9087-4dec-b7d3-cf8958b3f7a3 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:53.018551 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8122d82a-9087-4dec-b7d3-cf8958b3f7a3 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:53.022677 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8122d82a-9087-4dec-b7d3-cf8958b3f7a3 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:53.025030 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8122d82a-9087-4dec-b7d3-cf8958b3f7a3 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:53.379116 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-59a55e5e-a73d-4b68-b332-cc084120cef1 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:53.380431 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-59a55e5e-a73d-4b68-b332-cc084120cef1 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:53.389796 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-59a55e5e-a73d-4b68-b332-cc084120cef1 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:53.390370 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-59a55e5e-a73d-4b68-b332-cc084120cef1 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:53.391307 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-59a55e5e-a73d-4b68-b332-cc084120cef1 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:53.391800 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-59a55e5e-a73d-4b68-b332-cc084120cef1 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:53.522527 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-8122d82a-9087-4dec-b7d3-cf8958b3f7a3 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:53.537478 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-8122d82a-9087-4dec-b7d3-cf8958b3f7a3 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 200 len: 1363 microversion: 2.1 time: 0.534244 May 23 12:33:53.539336 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 31/62] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:33:53 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 1363 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:33:53.693544 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-59a55e5e-a73d-4b68-b332-cc084120cef1 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:53.704010 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-59a55e5e-a73d-4b68-b332-cc084120cef1 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1279 microversion: 2.1 time: 0.329420 May 23 12:33:53.716094 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 32/63] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:33:53 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1279 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:33:53.814660 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-b694aebd-49d9-4f7f-8168-0ad96face922 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:53.816437 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-b694aebd-49d9-4f7f-8168-0ad96face922 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:53.833962 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b694aebd-49d9-4f7f-8168-0ad96face922 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:53.834530 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b694aebd-49d9-4f7f-8168-0ad96face922 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:53.835486 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b694aebd-49d9-4f7f-8168-0ad96face922 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:53.836356 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b694aebd-49d9-4f7f-8168-0ad96face922 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:53.842842 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:53.946812 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c5597aa6-c7a0-4b0a-8845-13d18fd6c8a8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:53.947679 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c5597aa6-c7a0-4b0a-8845-13d18fd6c8a8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:53.961469 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c5597aa6-c7a0-4b0a-8845-13d18fd6c8a8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:53.962048 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c5597aa6-c7a0-4b0a-8845-13d18fd6c8a8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:53.963831 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c5597aa6-c7a0-4b0a-8845-13d18fd6c8a8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:53.966404 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c5597aa6-c7a0-4b0a-8845-13d18fd6c8a8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:53.967796 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell0:SELECT=4 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:55.279925 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-b694aebd-49d9-4f7f-8168-0ad96face922 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:55.291202 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-b694aebd-49d9-4f7f-8168-0ad96face922 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:55.300581 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-b694aebd-49d9-4f7f-8168-0ad96face922 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:55.302040 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-b694aebd-49d9-4f7f-8168-0ad96face922 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1408 microversion: 2.20 time: 1.492646 May 23 12:33:55.312569 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 32/64] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:33:53 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1408 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:33:55.320573 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-6b9b9829-d3e8-4d10-ab55-5b8eb6916639 req-61f397aa-544f-4d1f-b94c-6b3fbfde8b47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "380a99e6-38d9-4af6-9fa8-5506a0ffcf5e", "tag": "1c168015-cbd1-4ffe-8cf8-c803d21df858"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:33:55.337862 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-6b9b9829-d3e8-4d10-ab55-5b8eb6916639 req-61f397aa-544f-4d1f-b94c-6b3fbfde8b47 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:55.340780 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-6b9b9829-d3e8-4d10-ab55-5b8eb6916639 req-61f397aa-544f-4d1f-b94c-6b3fbfde8b47 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:55.387762 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-6b9b9829-d3e8-4d10-ab55-5b8eb6916639 req-61f397aa-544f-4d1f-b94c-6b3fbfde8b47 service nova] Creating event network-changed:1c168015-cbd1-4ffe-8cf8-c803d21df858 for instance 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e on hv-cinder-83699 May 23 12:33:55.406883 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-6b9b9829-d3e8-4d10-ab55-5b8eb6916639 req-61f397aa-544f-4d1f-b94c-6b3fbfde8b47 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092172 May 23 12:33:55.408090 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 33/65] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:33:55.422400 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-6dff131e-2d89-4683-8384-9f78b748a03d tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:55.423491 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-6dff131e-2d89-4683-8384-9f78b748a03d tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:55.444529 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6dff131e-2d89-4683-8384-9f78b748a03d tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:55.445036 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6dff131e-2d89-4683-8384-9f78b748a03d tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:55.446518 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6dff131e-2d89-4683-8384-9f78b748a03d tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:55.447200 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6dff131e-2d89-4683-8384-9f78b748a03d tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:55.554626 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c5597aa6-c7a0-4b0a-8845-13d18fd6c8a8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:55.577482 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c5597aa6-c7a0-4b0a-8845-13d18fd6c8a8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5" status: 200 len: 1366 microversion: 2.1 time: 1.633790 May 23 12:33:55.593427 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 33/66] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:33:53 2022] GET /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 => generated 1366 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:33:55.608882 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-c3ef7974-7f92-4aaa-b68e-d0b4b6468129 req-aa0b0b57-cd6a-467b-923b-e3c9ec579933 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5", "tag": "25a3b497-66c4-4bc0-887a-9599ceea33ec"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:33:55.626599 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-c3ef7974-7f92-4aaa-b68e-d0b4b6468129 req-aa0b0b57-cd6a-467b-923b-e3c9ec579933 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:55.629172 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-c3ef7974-7f92-4aaa-b68e-d0b4b6468129 req-aa0b0b57-cd6a-467b-923b-e3c9ec579933 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:55.662215 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-c3ef7974-7f92-4aaa-b68e-d0b4b6468129 req-aa0b0b57-cd6a-467b-923b-e3c9ec579933 service nova] Creating event network-changed:25a3b497-66c4-4bc0-887a-9599ceea33ec for instance 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 on hv-cinder-83699 May 23 12:33:55.678422 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-c3ef7974-7f92-4aaa-b68e-d0b4b6468129 req-aa0b0b57-cd6a-467b-923b-e3c9ec579933 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077190 May 23 12:33:55.679409 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 34/67] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:33:55.697193 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-7a0bb472-4c87-45fd-87b9-550d5b5711a5 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:55.702698 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-7a0bb472-4c87-45fd-87b9-550d5b5711a5 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:55.720354 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:55.722987 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7a0bb472-4c87-45fd-87b9-550d5b5711a5 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:55.724471 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7a0bb472-4c87-45fd-87b9-550d5b5711a5 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:55.727095 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7a0bb472-4c87-45fd-87b9-550d5b5711a5 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:55.729207 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7a0bb472-4c87-45fd-87b9-550d5b5711a5 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:56.457966 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-6dff131e-2d89-4683-8384-9f78b748a03d tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:56.479761 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-6dff131e-2d89-4683-8384-9f78b748a03d tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 200 len: 1363 microversion: 2.1 time: 1.062392 May 23 12:33:56.480770 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 34/68] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:33:55 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 1363 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:33:56.514606 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-e97265e8-c8b6-44bf-ab12-e72556e33c8e req-d0920c60-79e8-4db3-8676-f62ab51e7288 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce37af9c-e5f8-4233-97f3-4280a2114e45", "name": "network-vif-plugged", "status": "completed", "tag": "357ce430-3b90-4a7c-b2f3-c2ee303501e4"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:33:56.551464 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-e97265e8-c8b6-44bf-ab12-e72556e33c8e req-d0920c60-79e8-4db3-8676-f62ab51e7288 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:56.552409 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-e97265e8-c8b6-44bf-ab12-e72556e33c8e req-d0920c60-79e8-4db3-8676-f62ab51e7288 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:56.582870 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-e97265e8-c8b6-44bf-ab12-e72556e33c8e req-d0920c60-79e8-4db3-8676-f62ab51e7288 service nova] Creating event network-vif-plugged:357ce430-3b90-4a7c-b2f3-c2ee303501e4 for instance ce37af9c-e5f8-4233-97f3-4280a2114e45 on hv-cinder-83699 May 23 12:33:56.592400 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-e97265e8-c8b6-44bf-ab12-e72556e33c8e req-d0920c60-79e8-4db3-8676-f62ab51e7288 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103509 May 23 12:33:56.593742 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 35/69] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:33:56.600451 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-598c1091-f2b3-4037-969a-c9feb14f4e0a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:56.601439 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-598c1091-f2b3-4037-969a-c9feb14f4e0a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:56.610468 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-598c1091-f2b3-4037-969a-c9feb14f4e0a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:56.611206 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-598c1091-f2b3-4037-969a-c9feb14f4e0a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:56.612996 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-598c1091-f2b3-4037-969a-c9feb14f4e0a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:56.613637 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-598c1091-f2b3-4037-969a-c9feb14f4e0a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:57.020638 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-7a0bb472-4c87-45fd-87b9-550d5b5711a5 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:57.034916 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-7a0bb472-4c87-45fd-87b9-550d5b5711a5 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1321 microversion: 2.1 time: 1.353114 May 23 12:33:57.035504 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 35/70] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:33:55 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1321 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:33:57.060545 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-90680c9b-012c-47f8-9c3b-924c2e6ba43e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:57.061159 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-90680c9b-012c-47f8-9c3b-924c2e6ba43e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:57.073046 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-90680c9b-012c-47f8-9c3b-924c2e6ba43e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:57.073487 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-90680c9b-012c-47f8-9c3b-924c2e6ba43e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:57.074264 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-90680c9b-012c-47f8-9c3b-924c2e6ba43e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:57.077346 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-90680c9b-012c-47f8-9c3b-924c2e6ba43e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:57.198031 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-598c1091-f2b3-4037-969a-c9feb14f4e0a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:57.208670 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-598c1091-f2b3-4037-969a-c9feb14f4e0a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:57.210748 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-598c1091-f2b3-4037-969a-c9feb14f4e0a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:57.212768 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-598c1091-f2b3-4037-969a-c9feb14f4e0a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1408 microversion: 2.20 time: 0.617183 May 23 12:33:57.214357 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 36/71] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:33:56 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1408 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:33:57.499905 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-b7047f33-1435-4e46-b72e-75b2a38a59cb tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:57.500604 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-b7047f33-1435-4e46-b72e-75b2a38a59cb tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:57.520345 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b7047f33-1435-4e46-b72e-75b2a38a59cb tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:57.526969 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b7047f33-1435-4e46-b72e-75b2a38a59cb tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:57.528415 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b7047f33-1435-4e46-b72e-75b2a38a59cb tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:57.530239 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b7047f33-1435-4e46-b72e-75b2a38a59cb tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:57.566199 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-90680c9b-012c-47f8-9c3b-924c2e6ba43e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:57.577641 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-90680c9b-012c-47f8-9c3b-924c2e6ba43e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5" status: 200 len: 1366 microversion: 2.1 time: 0.521948 May 23 12:33:57.583824 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 36/72] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:33:57 2022] GET /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 => generated 1366 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:33:58.053736 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-3c677caa-40c7-4343-8a58-5ac97e195f73 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:58.054609 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-3c677caa-40c7-4343-8a58-5ac97e195f73 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:58.059292 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell0:SELECT=10 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:58.068100 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3c677caa-40c7-4343-8a58-5ac97e195f73 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:58.082817 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3c677caa-40c7-4343-8a58-5ac97e195f73 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:58.092863 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3c677caa-40c7-4343-8a58-5ac97e195f73 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:58.093661 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3c677caa-40c7-4343-8a58-5ac97e195f73 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:58.104936 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-b7047f33-1435-4e46-b72e-75b2a38a59cb tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:58.122299 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-b7047f33-1435-4e46-b72e-75b2a38a59cb tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 200 len: 1363 microversion: 2.1 time: 0.627756 May 23 12:33:58.126560 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 37/73] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:33:57 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 1363 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:33:58.232336 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-0fdba901-0c5e-43f0-b8c2-463c39380777 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:58.233802 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-0fdba901-0c5e-43f0-b8c2-463c39380777 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:58.246773 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0fdba901-0c5e-43f0-b8c2-463c39380777 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:58.250664 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0fdba901-0c5e-43f0-b8c2-463c39380777 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:58.253924 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0fdba901-0c5e-43f0-b8c2-463c39380777 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:58.254922 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0fdba901-0c5e-43f0-b8c2-463c39380777 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:58.669833 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell0:SELECT=36 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:58.713394 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-3c677caa-40c7-4343-8a58-5ac97e195f73 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:58.722850 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-3c677caa-40c7-4343-8a58-5ac97e195f73 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1321 microversion: 2.1 time: 0.674197 May 23 12:33:58.724306 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 37/74] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:33:58 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1321 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:33:58.745482 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-2a7e3063-ecaf-456e-9f7b-2e20d98aa833 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:58.746960 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-2a7e3063-ecaf-456e-9f7b-2e20d98aa833 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:58.770176 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2a7e3063-ecaf-456e-9f7b-2e20d98aa833 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:58.773253 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2a7e3063-ecaf-456e-9f7b-2e20d98aa833 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:58.777229 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2a7e3063-ecaf-456e-9f7b-2e20d98aa833 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:58.778225 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2a7e3063-ecaf-456e-9f7b-2e20d98aa833 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:58.806117 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-0fdba901-0c5e-43f0-b8c2-463c39380777 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:58.815625 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-0fdba901-0c5e-43f0-b8c2-463c39380777 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:58.818030 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-0fdba901-0c5e-43f0-b8c2-463c39380777 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:58.819250 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-0fdba901-0c5e-43f0-b8c2-463c39380777 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1408 microversion: 2.20 time: 0.592150 May 23 12:33:58.831488 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 38/75] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:33:58 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1408 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:33:58.836841 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-73c98c69-74fa-48b2-adaa-5b952c258d55 req-fb69ef7c-d134-42f5-9481-7ae2674b453d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cdb78f1-4de7-4c61-82e0-abe6c742e7aa", "name": "network-vif-plugged", "status": "completed", "tag": "47e7dcef-9f40-451c-adfd-004f425d19fb"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:33:58.846768 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-73c98c69-74fa-48b2-adaa-5b952c258d55 req-fb69ef7c-d134-42f5-9481-7ae2674b453d service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:58.847462 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-73c98c69-74fa-48b2-adaa-5b952c258d55 req-fb69ef7c-d134-42f5-9481-7ae2674b453d service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:58.864493 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-73c98c69-74fa-48b2-adaa-5b952c258d55 req-fb69ef7c-d134-42f5-9481-7ae2674b453d service nova] Creating event network-vif-plugged:47e7dcef-9f40-451c-adfd-004f425d19fb for instance 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa on hv-cinder-83699 May 23 12:33:58.873628 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-73c98c69-74fa-48b2-adaa-5b952c258d55 req-fb69ef7c-d134-42f5-9481-7ae2674b453d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040618 May 23 12:33:58.896025 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 39/76] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:33:58.906180 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-b4da10b1-17c6-4cdc-96e4-ce44b3cd4993 req-b575f7d6-e415-4033-91f1-a504786ee9d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6862b746-8558-4cd5-b71a-9a69ad923901", "tag": "c4590a1b-944a-40a6-ae11-0a586abe29b8"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:33:58.919831 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-b4da10b1-17c6-4cdc-96e4-ce44b3cd4993 req-b575f7d6-e415-4033-91f1-a504786ee9d3 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:58.921019 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-b4da10b1-17c6-4cdc-96e4-ce44b3cd4993 req-b575f7d6-e415-4033-91f1-a504786ee9d3 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:58.938658 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-b4da10b1-17c6-4cdc-96e4-ce44b3cd4993 req-b575f7d6-e415-4033-91f1-a504786ee9d3 service nova] Creating event network-changed:c4590a1b-944a-40a6-ae11-0a586abe29b8 for instance 6862b746-8558-4cd5-b71a-9a69ad923901 on hv-cinder-83699 May 23 12:33:58.945242 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-b4da10b1-17c6-4cdc-96e4-ce44b3cd4993 req-b575f7d6-e415-4033-91f1-a504786ee9d3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045890 May 23 12:33:58.946164 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 40/77] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:33:58.986770 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-2a7e3063-ecaf-456e-9f7b-2e20d98aa833 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:59.002635 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-2a7e3063-ecaf-456e-9f7b-2e20d98aa833 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5" status: 200 len: 1366 microversion: 2.1 time: 0.276579 May 23 12:33:59.003825 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 38/78] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:33:58 2022] GET /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 => generated 1366 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:33:59.143065 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-f715dddb-0f1c-4f34-8ebf-6b5713403f69 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:59.143773 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-f715dddb-0f1c-4f34-8ebf-6b5713403f69 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:59.156474 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f715dddb-0f1c-4f34-8ebf-6b5713403f69 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:59.156929 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f715dddb-0f1c-4f34-8ebf-6b5713403f69 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:59.157715 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f715dddb-0f1c-4f34-8ebf-6b5713403f69 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:59.158161 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f715dddb-0f1c-4f34-8ebf-6b5713403f69 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:59.439855 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-f715dddb-0f1c-4f34-8ebf-6b5713403f69 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:33:59.453017 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-f715dddb-0f1c-4f34-8ebf-6b5713403f69 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 200 len: 1363 microversion: 2.1 time: 0.312504 May 23 12:33:59.454917 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 41/79] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:33:59 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 1363 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:33:59.741514 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-7233acb6-bea9-4f9e-ae86-8f8cc43b5d61 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:59.742943 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-7233acb6-bea9-4f9e-ae86-8f8cc43b5d61 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:59.752094 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7233acb6-bea9-4f9e-ae86-8f8cc43b5d61 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:59.752817 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7233acb6-bea9-4f9e-ae86-8f8cc43b5d61 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:59.754563 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7233acb6-bea9-4f9e-ae86-8f8cc43b5d61 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:59.755204 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7233acb6-bea9-4f9e-ae86-8f8cc43b5d61 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:59.786916 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell1:SELECT=100 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:59.842650 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-fc96e395-6ae6-4247-8d19-350c780e8f96 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:33:59.845073 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-fc96e395-6ae6-4247-8d19-350c780e8f96 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:33:59.867523 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-fc96e395-6ae6-4247-8d19-350c780e8f96 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:59.868963 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-fc96e395-6ae6-4247-8d19-350c780e8f96 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:33:59.870714 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-fc96e395-6ae6-4247-8d19-350c780e8f96 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:33:59.872037 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-fc96e395-6ae6-4247-8d19-350c780e8f96 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:00.131627 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-7233acb6-bea9-4f9e-ae86-8f8cc43b5d61 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:00.140728 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-7233acb6-bea9-4f9e-ae86-8f8cc43b5d61 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1321 microversion: 2.1 time: 0.403984 May 23 12:34:00.142012 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 39/80] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:33:59 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1321 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:00.159030 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-ad629252-7d36-4102-98a8-fa8b6861bc6e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:00.159729 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-ad629252-7d36-4102-98a8-fa8b6861bc6e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:00.167784 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ad629252-7d36-4102-98a8-fa8b6861bc6e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:00.168360 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ad629252-7d36-4102-98a8-fa8b6861bc6e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:00.169389 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ad629252-7d36-4102-98a8-fa8b6861bc6e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:00.170043 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ad629252-7d36-4102-98a8-fa8b6861bc6e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:00.312998 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-fc96e395-6ae6-4247-8d19-350c780e8f96 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:00.336943 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-fc96e395-6ae6-4247-8d19-350c780e8f96 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:00.345052 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-fc96e395-6ae6-4247-8d19-350c780e8f96 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:00.346369 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-fc96e395-6ae6-4247-8d19-350c780e8f96 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1600 microversion: 2.20 time: 0.511918 May 23 12:34:00.347189 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 42/81] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:33:59 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1600 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:34:00.388227 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-7336f665-85f5-477b-8794-9a6b3d15440c tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:00.391997 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-7336f665-85f5-477b-8794-9a6b3d15440c tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:00.407137 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7336f665-85f5-477b-8794-9a6b3d15440c tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:00.407592 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7336f665-85f5-477b-8794-9a6b3d15440c tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:00.408812 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7336f665-85f5-477b-8794-9a6b3d15440c tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:00.409421 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7336f665-85f5-477b-8794-9a6b3d15440c tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:00.413106 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-ad629252-7d36-4102-98a8-fa8b6861bc6e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:00.422253 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-ad629252-7d36-4102-98a8-fa8b6861bc6e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5" status: 200 len: 1366 microversion: 2.1 time: 0.271437 May 23 12:34:00.427961 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 40/82] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:00 2022] GET /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 => generated 1366 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:00.471723 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-49231746-97de-4131-b958-9f6b5d36eed0 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:00.472534 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-49231746-97de-4131-b958-9f6b5d36eed0 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:00.483630 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-49231746-97de-4131-b958-9f6b5d36eed0 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:00.484318 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-49231746-97de-4131-b958-9f6b5d36eed0 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:00.485217 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-49231746-97de-4131-b958-9f6b5d36eed0 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:00.485729 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-49231746-97de-4131-b958-9f6b5d36eed0 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:00.578197 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-7336f665-85f5-477b-8794-9a6b3d15440c tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.202241 May 23 12:34:00.584613 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 43/83] 10.222.0.16 () {60 vars in 1315 bytes} [Mon May 23 12:34:00 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45/os-interface => generated 285 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 12:34:00.729408 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-49231746-97de-4131-b958-9f6b5d36eed0 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:00.741934 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-49231746-97de-4131-b958-9f6b5d36eed0 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 200 len: 1363 microversion: 2.1 time: 0.273936 May 23 12:34:00.746883 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 41/84] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:00 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 1363 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:34:00.912440 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-88004260-44e3-4eb7-888f-94a569def66d req-addd9fb2-de8d-43ba-afb8-8ae320ffb4c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5", "name": "network-vif-plugged", "status": "completed", "tag": "25a3b497-66c4-4bc0-887a-9599ceea33ec"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:34:00.926895 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-88004260-44e3-4eb7-888f-94a569def66d req-addd9fb2-de8d-43ba-afb8-8ae320ffb4c5 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:00.927294 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-88004260-44e3-4eb7-888f-94a569def66d req-addd9fb2-de8d-43ba-afb8-8ae320ffb4c5 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:00.954730 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-88004260-44e3-4eb7-888f-94a569def66d req-addd9fb2-de8d-43ba-afb8-8ae320ffb4c5 service nova] Creating event network-vif-plugged:25a3b497-66c4-4bc0-887a-9599ceea33ec for instance 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 on hv-cinder-83699 May 23 12:34:00.964202 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-88004260-44e3-4eb7-888f-94a569def66d req-addd9fb2-de8d-43ba-afb8-8ae320ffb4c5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055769 May 23 12:34:00.965156 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 44/85] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:34:01.159465 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-51f6a8f2-4339-47db-afef-83098f734433 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:01.160459 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-51f6a8f2-4339-47db-afef-83098f734433 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:01.188823 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-51f6a8f2-4339-47db-afef-83098f734433 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:01.189528 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-51f6a8f2-4339-47db-afef-83098f734433 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:01.190716 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-51f6a8f2-4339-47db-afef-83098f734433 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:01.191313 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-51f6a8f2-4339-47db-afef-83098f734433 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:01.448662 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-147c871a-aedd-4849-a2da-644f56a21f97 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:01.449877 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-147c871a-aedd-4849-a2da-644f56a21f97 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:01.464516 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-147c871a-aedd-4849-a2da-644f56a21f97 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:01.470911 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-147c871a-aedd-4849-a2da-644f56a21f97 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:01.472321 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-147c871a-aedd-4849-a2da-644f56a21f97 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:01.473799 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-147c871a-aedd-4849-a2da-644f56a21f97 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:01.494555 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-51f6a8f2-4339-47db-afef-83098f734433 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:01.510400 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-51f6a8f2-4339-47db-afef-83098f734433 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1321 microversion: 2.1 time: 0.349730 May 23 12:34:01.523217 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 42/86] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:01 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1321 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:01.765804 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-7d2cdfc9-0fe7-4146-be0d-e6624505e656 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:01.766823 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-7d2cdfc9-0fe7-4146-be0d-e6624505e656 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:01.783306 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7d2cdfc9-0fe7-4146-be0d-e6624505e656 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:01.783937 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7d2cdfc9-0fe7-4146-be0d-e6624505e656 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:01.785070 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7d2cdfc9-0fe7-4146-be0d-e6624505e656 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:01.785780 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7d2cdfc9-0fe7-4146-be0d-e6624505e656 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:02.068724 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-147c871a-aedd-4849-a2da-644f56a21f97 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:02.091699 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-147c871a-aedd-4849-a2da-644f56a21f97 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5" status: 200 len: 1366 microversion: 2.1 time: 0.650590 May 23 12:34:02.096854 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 45/87] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:01 2022] GET /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 => generated 1366 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:34:02.179813 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-7d2cdfc9-0fe7-4146-be0d-e6624505e656 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:02.195329 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-7d2cdfc9-0fe7-4146-be0d-e6624505e656 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 200 len: 1363 microversion: 2.1 time: 0.433273 May 23 12:34:02.198173 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 43/88] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:01 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 1363 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:34:02.531704 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-e58410bc-6ec6-4ada-bca1-160e3db7ad89 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:02.531704 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-e58410bc-6ec6-4ada-bca1-160e3db7ad89 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:02.540950 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e58410bc-6ec6-4ada-bca1-160e3db7ad89 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:02.543941 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e58410bc-6ec6-4ada-bca1-160e3db7ad89 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:02.545436 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e58410bc-6ec6-4ada-bca1-160e3db7ad89 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:02.546233 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e58410bc-6ec6-4ada-bca1-160e3db7ad89 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:02.920602 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-e58410bc-6ec6-4ada-bca1-160e3db7ad89 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:02.961121 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-e58410bc-6ec6-4ada-bca1-160e3db7ad89 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1321 microversion: 2.1 time: 0.434179 May 23 12:34:02.970064 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 46/89] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:02 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1321 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:02.988312 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-2fefb024-4882-43cc-a331-612e2b428ba8 req-2a106238-a4cb-40b1-8d67-ae2e67114a35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce37af9c-e5f8-4233-97f3-4280a2114e45", "tag": "357ce430-3b90-4a7c-b2f3-c2ee303501e4"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:34:03.007089 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-2fefb024-4882-43cc-a331-612e2b428ba8 req-2a106238-a4cb-40b1-8d67-ae2e67114a35 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:03.007547 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-2fefb024-4882-43cc-a331-612e2b428ba8 req-2a106238-a4cb-40b1-8d67-ae2e67114a35 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:03.048652 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-2fefb024-4882-43cc-a331-612e2b428ba8 req-2a106238-a4cb-40b1-8d67-ae2e67114a35 service nova] Creating event network-changed:357ce430-3b90-4a7c-b2f3-c2ee303501e4 for instance ce37af9c-e5f8-4233-97f3-4280a2114e45 on hv-cinder-83699 May 23 12:34:03.065989 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-2fefb024-4882-43cc-a331-612e2b428ba8 req-2a106238-a4cb-40b1-8d67-ae2e67114a35 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080167 May 23 12:34:03.070743 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 44/90] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:34:03.121624 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-9bb313e7-e8fd-4ed5-b907-794da6f9a36d tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:03.123115 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-9bb313e7-e8fd-4ed5-b907-794da6f9a36d tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:03.123990 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-8a30f381-51fc-4ea4-ac46-0a747bb00e57 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:03.125271 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-8a30f381-51fc-4ea4-ac46-0a747bb00e57 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] [instance: cb177d8b-e293-48e0-ad13-3227f2a2e78a] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:03.136806 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9bb313e7-e8fd-4ed5-b907-794da6f9a36d tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:03.137795 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9bb313e7-e8fd-4ed5-b907-794da6f9a36d tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:03.138771 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8a30f381-51fc-4ea4-ac46-0a747bb00e57 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:03.141123 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9bb313e7-e8fd-4ed5-b907-794da6f9a36d tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:03.143650 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9bb313e7-e8fd-4ed5-b907-794da6f9a36d tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:03.144330 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8a30f381-51fc-4ea4-ac46-0a747bb00e57 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:03.147074 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8a30f381-51fc-4ea4-ac46-0a747bb00e57 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:03.147878 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8a30f381-51fc-4ea4-ac46-0a747bb00e57 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:03.199143 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-8a30f381-51fc-4ea4-ac46-0a747bb00e57 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] [instance: cb177d8b-e293-48e0-ad13-3227f2a2e78a] Going to try to terminate instance {{(pid=124199) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 12:34:03.454155 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-8a30f381-51fc-4ea4-ac46-0a747bb00e57 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a" status: 204 len: 0 microversion: 2.1 time: 0.333575 May 23 12:34:03.455411 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 45/91] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 12:34:03 2022] DELETE /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 12:34:03.469820 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-2c2f4757-3367-4256-a994-e68e17d9a91c tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:03.471371 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-2c2f4757-3367-4256-a994-e68e17d9a91c tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:03.491413 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2c2f4757-3367-4256-a994-e68e17d9a91c tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:03.495840 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2c2f4757-3367-4256-a994-e68e17d9a91c tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:03.499136 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2c2f4757-3367-4256-a994-e68e17d9a91c tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:03.499888 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2c2f4757-3367-4256-a994-e68e17d9a91c tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:03.814924 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-9bb313e7-e8fd-4ed5-b907-794da6f9a36d tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:03.832448 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-9bb313e7-e8fd-4ed5-b907-794da6f9a36d tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5" status: 200 len: 1366 microversion: 2.1 time: 0.721497 May 23 12:34:03.832834 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 47/92] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:03 2022] GET /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 => generated 1366 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:03.845760 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-09e844d0-77df-4119-b7e5-d7ca6b887848 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:03.847017 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-09e844d0-77df-4119-b7e5-d7ca6b887848 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] [instance: cb177d8b-e293-48e0-ad13-3227f2a2e78a] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:03.858750 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-09e844d0-77df-4119-b7e5-d7ca6b887848 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:03.861636 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-09e844d0-77df-4119-b7e5-d7ca6b887848 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:03.864116 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-09e844d0-77df-4119-b7e5-d7ca6b887848 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:03.864899 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-09e844d0-77df-4119-b7e5-d7ca6b887848 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:04.219401 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-2c2f4757-3367-4256-a994-e68e17d9a91c tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:04.238352 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-2c2f4757-3367-4256-a994-e68e17d9a91c tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 200 len: 1363 microversion: 2.1 time: 0.781336 May 23 12:34:04.242128 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 46/93] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:03 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 1363 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:04.263845 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-e5d9b7f8-bcc9-41aa-98cf-44c4a0579b78 req-180be134-1ff6-49b9-9e03-4fe4f531a14c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "380a99e6-38d9-4af6-9fa8-5506a0ffcf5e", "name": "network-vif-plugged", "status": "completed", "tag": "1c168015-cbd1-4ffe-8cf8-c803d21df858"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:34:04.267656 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-09e844d0-77df-4119-b7e5-d7ca6b887848 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2936fe7026046aa9c43f1b1b0cb1bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f94aad6b61d49da817d70d2b91a7594', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:04.276006 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-e5d9b7f8-bcc9-41aa-98cf-44c4a0579b78 req-180be134-1ff6-49b9-9e03-4fe4f531a14c service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:04.276856 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-e5d9b7f8-bcc9-41aa-98cf-44c4a0579b78 req-180be134-1ff6-49b9-9e03-4fe4f531a14c service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:04.286613 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-09e844d0-77df-4119-b7e5-d7ca6b887848 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] 10.222.0.16 "GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a" status: 200 len: 1552 microversion: 2.1 time: 0.451863 May 23 12:34:04.309206 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 48/94] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:03 2022] GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a => generated 1552 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:04.310369 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-e5d9b7f8-bcc9-41aa-98cf-44c4a0579b78 req-180be134-1ff6-49b9-9e03-4fe4f531a14c service nova] Creating event network-vif-plugged:1c168015-cbd1-4ffe-8cf8-c803d21df858 for instance 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e on hv-cinder-83699 May 23 12:34:04.320439 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-8a2cb8e6-7911-45de-9f01-bf95a780baee tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:04.320439 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-8a2cb8e6-7911-45de-9f01-bf95a780baee tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:04.332293 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-e5d9b7f8-bcc9-41aa-98cf-44c4a0579b78 req-180be134-1ff6-49b9-9e03-4fe4f531a14c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069214 May 23 12:34:04.338513 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8a2cb8e6-7911-45de-9f01-bf95a780baee tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:04.338513 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8a2cb8e6-7911-45de-9f01-bf95a780baee tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:04.338513 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8a2cb8e6-7911-45de-9f01-bf95a780baee tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:04.338513 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8a2cb8e6-7911-45de-9f01-bf95a780baee tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:04.340741 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 47/95] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:34:04.677573 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-8a2cb8e6-7911-45de-9f01-bf95a780baee tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:04.687518 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-8a2cb8e6-7911-45de-9f01-bf95a780baee tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1321 microversion: 2.1 time: 0.374799 May 23 12:34:04.689483 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 49/96] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:04 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1321 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:04.848877 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c522cf8b-efb0-4996-b3f5-c6c1ac2c3763 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:04.850113 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c522cf8b-efb0-4996-b3f5-c6c1ac2c3763 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:04.864349 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c522cf8b-efb0-4996-b3f5-c6c1ac2c3763 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:04.864976 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c522cf8b-efb0-4996-b3f5-c6c1ac2c3763 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:04.866244 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c522cf8b-efb0-4996-b3f5-c6c1ac2c3763 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:04.866860 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c522cf8b-efb0-4996-b3f5-c6c1ac2c3763 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:05.104694 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c522cf8b-efb0-4996-b3f5-c6c1ac2c3763 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:05.115845 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c522cf8b-efb0-4996-b3f5-c6c1ac2c3763 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5" status: 200 len: 1366 microversion: 2.1 time: 0.271126 May 23 12:34:05.116747 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 48/97] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:04 2022] GET /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 => generated 1366 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:05.260114 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-8f2c0ada-f7c6-4412-b95b-10c63a0b83d3 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:05.261261 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-8f2c0ada-f7c6-4412-b95b-10c63a0b83d3 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:05.275801 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8f2c0ada-f7c6-4412-b95b-10c63a0b83d3 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:05.277889 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8f2c0ada-f7c6-4412-b95b-10c63a0b83d3 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:05.280929 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8f2c0ada-f7c6-4412-b95b-10c63a0b83d3 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:05.285299 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8f2c0ada-f7c6-4412-b95b-10c63a0b83d3 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:05.311800 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-5cdff6cf-d578-4e66-87b7-00acb543c91b tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:05.313304 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-5cdff6cf-d578-4e66-87b7-00acb543c91b tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] [instance: cb177d8b-e293-48e0-ad13-3227f2a2e78a] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:05.333320 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5cdff6cf-d578-4e66-87b7-00acb543c91b tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:05.335991 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5cdff6cf-d578-4e66-87b7-00acb543c91b tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:05.336950 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5cdff6cf-d578-4e66-87b7-00acb543c91b tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:05.337531 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5cdff6cf-d578-4e66-87b7-00acb543c91b tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:05.717919 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-5cdff6cf-d578-4e66-87b7-00acb543c91b tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2936fe7026046aa9c43f1b1b0cb1bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f94aad6b61d49da817d70d2b91a7594', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:05.730232 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-5cdff6cf-d578-4e66-87b7-00acb543c91b tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] 10.222.0.16 "GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a" status: 200 len: 1552 microversion: 2.1 time: 0.424637 May 23 12:34:05.731504 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 49/98] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:05 2022] GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a => generated 1552 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:34:05.732818 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-8f2c0ada-f7c6-4412-b95b-10c63a0b83d3 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:05.739893 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f997ba61-863c-4ca7-95c6-c36ee023df96 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:05.741245 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-f997ba61-863c-4ca7-95c6-c36ee023df96 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:05.748848 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-8f2c0ada-f7c6-4412-b95b-10c63a0b83d3 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 200 len: 1363 microversion: 2.1 time: 0.493812 May 23 12:34:05.749439 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 50/99] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:05 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 1363 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:05.759957 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f997ba61-863c-4ca7-95c6-c36ee023df96 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:05.762671 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f997ba61-863c-4ca7-95c6-c36ee023df96 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:05.765586 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f997ba61-863c-4ca7-95c6-c36ee023df96 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:05.766226 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f997ba61-863c-4ca7-95c6-c36ee023df96 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:06.093626 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f997ba61-863c-4ca7-95c6-c36ee023df96 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:06.102799 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f997ba61-863c-4ca7-95c6-c36ee023df96 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1321 microversion: 2.1 time: 0.369066 May 23 12:34:06.103397 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 50/100] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:05 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1321 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:06.134176 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-ace4a4bf-ec77-418f-ab94-ae6ad1e087d9 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:06.134963 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-ace4a4bf-ec77-418f-ab94-ae6ad1e087d9 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:06.141036 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ace4a4bf-ec77-418f-ab94-ae6ad1e087d9 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:06.141477 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ace4a4bf-ec77-418f-ab94-ae6ad1e087d9 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:06.142243 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ace4a4bf-ec77-418f-ab94-ae6ad1e087d9 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:06.142670 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ace4a4bf-ec77-418f-ab94-ae6ad1e087d9 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:06.368628 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-ace4a4bf-ec77-418f-ab94-ae6ad1e087d9 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:06.375943 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-ace4a4bf-ec77-418f-ab94-ae6ad1e087d9 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5" status: 200 len: 1366 microversion: 2.1 time: 0.245844 May 23 12:34:06.380490 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 51/101] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:06 2022] GET /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:06.749651 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-8272a3b6-c68a-41bc-8088-87c6a21a5c9f tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:06.750768 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-8272a3b6-c68a-41bc-8088-87c6a21a5c9f tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] [instance: cb177d8b-e293-48e0-ad13-3227f2a2e78a] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:06.763739 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8272a3b6-c68a-41bc-8088-87c6a21a5c9f tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:06.764918 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8272a3b6-c68a-41bc-8088-87c6a21a5c9f tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:06.767025 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8272a3b6-c68a-41bc-8088-87c6a21a5c9f tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:06.773983 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-1e701512-66bf-4880-a219-43fa0a23bf97 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:06.774828 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-1e701512-66bf-4880-a219-43fa0a23bf97 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:06.787089 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8272a3b6-c68a-41bc-8088-87c6a21a5c9f tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:06.792015 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1e701512-66bf-4880-a219-43fa0a23bf97 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:06.798254 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1e701512-66bf-4880-a219-43fa0a23bf97 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:06.817954 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1e701512-66bf-4880-a219-43fa0a23bf97 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:06.818416 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1e701512-66bf-4880-a219-43fa0a23bf97 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:06.857399 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell1:SELECT=100 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:07.361881 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-1e701512-66bf-4880-a219-43fa0a23bf97 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:07.376275 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-1e701512-66bf-4880-a219-43fa0a23bf97 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 200 len: 1363 microversion: 2.1 time: 0.604735 May 23 12:34:07.379630 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 52/102] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:06 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 1363 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:07.385853 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-9909bc4e-2df0-470a-9b0d-9652734ecb43 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:07.386479 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-9909bc4e-2df0-470a-9b0d-9652734ecb43 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:07.393221 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9909bc4e-2df0-470a-9b0d-9652734ecb43 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:07.394004 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9909bc4e-2df0-470a-9b0d-9652734ecb43 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:07.395117 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9909bc4e-2df0-470a-9b0d-9652734ecb43 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:07.395940 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9909bc4e-2df0-470a-9b0d-9652734ecb43 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:07.445246 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-8272a3b6-c68a-41bc-8088-87c6a21a5c9f tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2936fe7026046aa9c43f1b1b0cb1bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f94aad6b61d49da817d70d2b91a7594', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:07.457060 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-8272a3b6-c68a-41bc-8088-87c6a21a5c9f tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] 10.222.0.16 "GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a" status: 200 len: 1552 microversion: 2.1 time: 0.713161 May 23 12:34:07.457842 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 51/103] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:06 2022] GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a => generated 1552 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:07.463645 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-7e7ba924-edc8-4a16-a653-a17f5f9399b0 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:07.464587 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-7e7ba924-edc8-4a16-a653-a17f5f9399b0 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:07.470933 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7e7ba924-edc8-4a16-a653-a17f5f9399b0 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:07.471537 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7e7ba924-edc8-4a16-a653-a17f5f9399b0 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:07.472424 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7e7ba924-edc8-4a16-a653-a17f5f9399b0 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:07.473080 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7e7ba924-edc8-4a16-a653-a17f5f9399b0 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:07.826895 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-9909bc4e-2df0-470a-9b0d-9652734ecb43 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:07.841314 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-9909bc4e-2df0-470a-9b0d-9652734ecb43 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1321 microversion: 2.1 time: 0.460122 May 23 12:34:07.842085 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 53/104] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:07 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1321 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:07.848127 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-7ee34cd4-0ff7-4f79-8eb9-c5e96a60958b req-220be4e6-5b39-40ef-8125-c8b01378da4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb177d8b-e293-48e0-ad13-3227f2a2e78a", "name": "network-vif-deleted", "tag": "c165f7a4-5ae0-43f4-b352-6a0940825a20"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:34:07.858855 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-7ee34cd4-0ff7-4f79-8eb9-c5e96a60958b req-220be4e6-5b39-40ef-8125-c8b01378da4e service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:07.859328 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-7ee34cd4-0ff7-4f79-8eb9-c5e96a60958b req-220be4e6-5b39-40ef-8125-c8b01378da4e service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:07.873858 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-7ee34cd4-0ff7-4f79-8eb9-c5e96a60958b req-220be4e6-5b39-40ef-8125-c8b01378da4e service nova] Creating event network-vif-deleted:c165f7a4-5ae0-43f4-b352-6a0940825a20 for instance cb177d8b-e293-48e0-ad13-3227f2a2e78a on hv-cinder-83699 May 23 12:34:07.879471 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-7ee34cd4-0ff7-4f79-8eb9-c5e96a60958b req-220be4e6-5b39-40ef-8125-c8b01378da4e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035570 May 23 12:34:07.880497 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 54/105] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:34:07.893975 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-7e7ba924-edc8-4a16-a653-a17f5f9399b0 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:07.904633 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-7e7ba924-edc8-4a16-a653-a17f5f9399b0 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5" status: 200 len: 1555 microversion: 2.1 time: 0.445441 May 23 12:34:07.905385 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 52/106] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:07 2022] GET /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 => generated 1555 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:07.925567 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-7f70777e-f570-41e6-b0b9-1d01851165bb tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:07.926198 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-7f70777e-f570-41e6-b0b9-1d01851165bb tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:07.933969 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7f70777e-f570-41e6-b0b9-1d01851165bb tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:07.934420 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7f70777e-f570-41e6-b0b9-1d01851165bb tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:07.935205 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7f70777e-f570-41e6-b0b9-1d01851165bb tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:07.935653 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7f70777e-f570-41e6-b0b9-1d01851165bb tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:08.089436 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-7f70777e-f570-41e6-b0b9-1d01851165bb tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.168309 May 23 12:34:08.094943 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 55/107] 10.222.0.16 () {58 vars in 1274 bytes} [Mon May 23 12:34:07 2022] GET /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5/os-interface => generated 284 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:34:08.399616 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-5dc2a517-1fbe-41c2-8e13-491815fc6f64 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:08.401807 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-5dc2a517-1fbe-41c2-8e13-491815fc6f64 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:08.413602 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5dc2a517-1fbe-41c2-8e13-491815fc6f64 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:08.414262 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5dc2a517-1fbe-41c2-8e13-491815fc6f64 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:08.415922 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5dc2a517-1fbe-41c2-8e13-491815fc6f64 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:08.416387 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5dc2a517-1fbe-41c2-8e13-491815fc6f64 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:08.475340 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-b966b970-8759-4f1d-943b-76bff7510c87 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:08.475939 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-b966b970-8759-4f1d-943b-76bff7510c87 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] [instance: cb177d8b-e293-48e0-ad13-3227f2a2e78a] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:08.492851 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b966b970-8759-4f1d-943b-76bff7510c87 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:08.493427 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b966b970-8759-4f1d-943b-76bff7510c87 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:08.506075 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b966b970-8759-4f1d-943b-76bff7510c87 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:08.507002 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b966b970-8759-4f1d-943b-76bff7510c87 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:08.612704 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-b966b970-8759-4f1d-943b-76bff7510c87 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2936fe7026046aa9c43f1b1b0cb1bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f94aad6b61d49da817d70d2b91a7594', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:08.629607 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-b966b970-8759-4f1d-943b-76bff7510c87 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] 10.222.0.16 "GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a" status: 200 len: 1510 microversion: 2.1 time: 0.158508 May 23 12:34:08.637701 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-5dc2a517-1fbe-41c2-8e13-491815fc6f64 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:08.642219 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 56/108] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:08 2022] GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a => generated 1510 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:34:08.646559 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-5dc2a517-1fbe-41c2-8e13-491815fc6f64 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 200 len: 1363 microversion: 2.1 time: 0.251450 May 23 12:34:08.647471 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 53/109] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:08 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 1363 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:08.862344 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-a3cee4ea-254b-478c-818a-2b1ddf4ae705 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:08.863804 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-a3cee4ea-254b-478c-818a-2b1ddf4ae705 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:08.883319 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a3cee4ea-254b-478c-818a-2b1ddf4ae705 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:08.885551 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a3cee4ea-254b-478c-818a-2b1ddf4ae705 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:08.886417 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a3cee4ea-254b-478c-818a-2b1ddf4ae705 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:08.886968 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a3cee4ea-254b-478c-818a-2b1ddf4ae705 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:09.328094 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-a3cee4ea-254b-478c-818a-2b1ddf4ae705 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:09.336576 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-a3cee4ea-254b-478c-818a-2b1ddf4ae705 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1321 microversion: 2.1 time: 0.480724 May 23 12:34:09.337168 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 57/110] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:08 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1321 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:09.650207 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-7db2217a-c00f-4742-b174-eee5ee058994 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:09.650860 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-7db2217a-c00f-4742-b174-eee5ee058994 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] [instance: cb177d8b-e293-48e0-ad13-3227f2a2e78a] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:09.663889 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-c29c9c21-7d63-4dbf-a40d-02541a5b1607 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:09.665838 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-c29c9c21-7d63-4dbf-a40d-02541a5b1607 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:09.669285 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7db2217a-c00f-4742-b174-eee5ee058994 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:09.669606 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:09.669758 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7db2217a-c00f-4742-b174-eee5ee058994 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:09.670581 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7db2217a-c00f-4742-b174-eee5ee058994 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:09.671061 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7db2217a-c00f-4742-b174-eee5ee058994 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:09.678161 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c29c9c21-7d63-4dbf-a40d-02541a5b1607 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:09.682079 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c29c9c21-7d63-4dbf-a40d-02541a5b1607 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:09.686480 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c29c9c21-7d63-4dbf-a40d-02541a5b1607 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:09.687256 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c29c9c21-7d63-4dbf-a40d-02541a5b1607 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:09.874686 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-7db2217a-c00f-4742-b174-eee5ee058994 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2936fe7026046aa9c43f1b1b0cb1bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f94aad6b61d49da817d70d2b91a7594', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:09.891106 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-7db2217a-c00f-4742-b174-eee5ee058994 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] 10.222.0.16 "GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a" status: 200 len: 1345 microversion: 2.1 time: 0.239807 May 23 12:34:09.892086 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 54/111] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:09 2022] GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a => generated 1345 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:09.905943 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-2ee716ef-3dfe-432d-b392-d54e9f8f0ed4 req-3d292581-3ef3-4d07-9f5e-d0074cf49706 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5", "tag": "25a3b497-66c4-4bc0-887a-9599ceea33ec"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:34:09.934989 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-2ee716ef-3dfe-432d-b392-d54e9f8f0ed4 req-3d292581-3ef3-4d07-9f5e-d0074cf49706 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:09.939539 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-2ee716ef-3dfe-432d-b392-d54e9f8f0ed4 req-3d292581-3ef3-4d07-9f5e-d0074cf49706 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:09.981357 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-2ee716ef-3dfe-432d-b392-d54e9f8f0ed4 req-3d292581-3ef3-4d07-9f5e-d0074cf49706 service nova] Creating event network-changed:25a3b497-66c4-4bc0-887a-9599ceea33ec for instance 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 on hv-cinder-83699 May 23 12:34:10.018356 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-2ee716ef-3dfe-432d-b392-d54e9f8f0ed4 req-3d292581-3ef3-4d07-9f5e-d0074cf49706 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120013 May 23 12:34:10.028251 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 55/112] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:34:10.078580 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-c29c9c21-7d63-4dbf-a40d-02541a5b1607 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:10.089788 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-c29c9c21-7d63-4dbf-a40d-02541a5b1607 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 200 len: 1363 microversion: 2.1 time: 0.429626 May 23 12:34:10.090683 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 58/113] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:09 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 1363 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:10.356410 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-bcc5e91e-b344-4b45-acf0-ae8e67fb7edf tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:10.357663 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-bcc5e91e-b344-4b45-acf0-ae8e67fb7edf tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:10.368699 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bcc5e91e-b344-4b45-acf0-ae8e67fb7edf tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:10.369171 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bcc5e91e-b344-4b45-acf0-ae8e67fb7edf tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:10.371801 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bcc5e91e-b344-4b45-acf0-ae8e67fb7edf tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:10.372759 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bcc5e91e-b344-4b45-acf0-ae8e67fb7edf tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:10.395817 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:10.670039 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-bcc5e91e-b344-4b45-acf0-ae8e67fb7edf tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:10.685252 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-bcc5e91e-b344-4b45-acf0-ae8e67fb7edf tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1321 microversion: 2.1 time: 0.332280 May 23 12:34:10.686666 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 56/114] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:10 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1321 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:34:10.909786 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-26a9fd05-7c58-4cf9-b220-6424efa8fbbb tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:10.910462 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-26a9fd05-7c58-4cf9-b220-6424efa8fbbb tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] [instance: cb177d8b-e293-48e0-ad13-3227f2a2e78a] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:10.919330 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-26a9fd05-7c58-4cf9-b220-6424efa8fbbb tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:10.919791 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-26a9fd05-7c58-4cf9-b220-6424efa8fbbb tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:10.920660 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-26a9fd05-7c58-4cf9-b220-6424efa8fbbb tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:10.921251 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-26a9fd05-7c58-4cf9-b220-6424efa8fbbb tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:10.938774 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.wsgi [None req-26a9fd05-7c58-4cf9-b220-6424efa8fbbb tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] HTTP exception thrown: Instance cb177d8b-e293-48e0-ad13-3227f2a2e78a could not be found. May 23 12:34:10.947470 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-26a9fd05-7c58-4cf9-b220-6424efa8fbbb tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Request method failure captured: May 23 12:34:10.947470 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: request: GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a HTTP/1.1 May 23 12:34:10.947470 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept: application/json May 23 12:34:10.947470 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept-Encoding: identity May 23 12:34:10.947470 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Connection: close May 23 12:34:10.947470 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Length: 0 May 23 12:34:10.947470 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Type: application/json May 23 12:34:10.947470 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Host: 10.222.0.16 May 23 12:34:10.947470 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Openstack-System-Scope: None May 23 12:34:10.947470 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: User-Agent: python-urllib3/1.26.9 May 23 12:34:10.947470 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Auth-Token: gAAAAABii38BTvf7pgHXIPozU6AMkCyc7hA-8_iLCrY6gusv1sIKb5hHxaPXzSC5LTPWJtD1uNlm4Ud702rGrPFGUlF1JsfY-j1Wo_wlpLTO0CF-34Aes-eZpj0udurHWpAHGzBaxrqmTmXTKRpuIly0JQONLg9ALTik1BZ1AtdawV8lKmbyEWs May 23 12:34:10.947470 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Id: None May 23 12:34:10.947470 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Name: None May 23 12:34:10.947470 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Identity-Status: Confirmed May 23 12:34:10.947470 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Is-Admin-Project: True May 23 12:34:10.947470 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Id: default May 23 12:34:10.947470 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Name: Default May 23 12:34:10.947470 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Id: 1f94aad6b61d49da817d70d2b91a7594 May 23 12:34:10.947470 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Name: tempest-DeleteServersTestJSON-259516189 May 23 12:34:10.947470 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Role: member,reader May 23 12:34:10.947470 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Roles: member,reader May 23 12:34:10.948812 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1f94aad6b61d49da817d70d2b91a7594"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1f94aad6b61d49da817d70d2b91a7594"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1f94aad6b61d49da817d70d2b91a7594", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1f94aad6b61d49da817d70d2b91a7594"}]}] May 23 12:34:10.948812 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant: tempest-DeleteServersTestJSON-259516189 May 23 12:34:10.948812 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Id: 1f94aad6b61d49da817d70d2b91a7594 May 23 12:34:10.948812 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Name: tempest-DeleteServersTestJSON-259516189 May 23 12:34:10.948812 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User: tempest-DeleteServersTestJSON-259516189-project May 23 12:34:10.948812 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Id: default May 23 12:34:10.948812 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Name: Default May 23 12:34:10.948812 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Id: f2936fe7026046aa9c43f1b1b0cb1bfd May 23 12:34:10.948812 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Name: tempest-DeleteServersTestJSON-259516189-project May 23 12:34:10.948812 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: method: > May 23 12:34:10.948812 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: exception: Instance cb177d8b-e293-48e0-ad13-3227f2a2e78a could not be found. May 23 12:34:10.948812 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: action_args: {'id': 'cb177d8b-e293-48e0-ad13-3227f2a2e78a'} May 23 12:34:10.949706 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:34:10.949706 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:34:10.949706 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:34:10.949706 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:34:10.949706 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:34:10.949706 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:34:10.949706 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:34:10.949706 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:34:10.949706 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:34:10.949706 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:34:10.949706 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb177d8b-e293-48e0-ad13-3227f2a2e78a could not be found. May 23 12:34:10.949706 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:34:10.949706 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:34:10.949706 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:34:10.949706 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:34:10.949706 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:34:10.949706 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:34:10.949706 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:34:10.949706 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:34:10.949706 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:34:10.951109 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:34:10.951109 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:34:10.951109 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:34:10.951109 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:34:10.951109 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:34:10.951109 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:34:10.951109 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:34:10.951109 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb177d8b-e293-48e0-ad13-3227f2a2e78a could not be found. May 23 12:34:10.951109 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:34:10.951109 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:34:10.951109 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:34:10.951109 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:34:10.951109 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:34:10.951109 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:34:10.951109 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:34:10.951109 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:34:10.951109 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb177d8b-e293-48e0-ad13-3227f2a2e78a could not be found. May 23 12:34:10.951109 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:34:10.953064 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-26a9fd05-7c58-4cf9-b220-6424efa8fbbb tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Returning 404 to user: Instance cb177d8b-e293-48e0-ad13-3227f2a2e78a could not be found. {{(pid=124200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:34:10.953064 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-26a9fd05-7c58-4cf9-b220-6424efa8fbbb tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] 10.222.0.16 "GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a" status: 404 len: 111 microversion: 2.1 time: 0.044715 May 23 12:34:10.955268 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 59/115] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:10 2022] GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:34:11.109104 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-5796f48b-09d7-46a6-bef9-144c89d45b60 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:11.109744 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-5796f48b-09d7-46a6-bef9-144c89d45b60 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:11.125571 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5796f48b-09d7-46a6-bef9-144c89d45b60 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:11.126028 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5796f48b-09d7-46a6-bef9-144c89d45b60 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:11.126825 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5796f48b-09d7-46a6-bef9-144c89d45b60 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:11.127264 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5796f48b-09d7-46a6-bef9-144c89d45b60 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:11.191926 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-5c7775db-cf9d-4f29-9088-8cb468d5f912 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:11.193255 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-5c7775db-cf9d-4f29-9088-8cb468d5f912 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] [instance: cb177d8b-e293-48e0-ad13-3227f2a2e78a] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:11.204489 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5c7775db-cf9d-4f29-9088-8cb468d5f912 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:11.205295 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5c7775db-cf9d-4f29-9088-8cb468d5f912 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:11.206303 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5c7775db-cf9d-4f29-9088-8cb468d5f912 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:11.206981 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5c7775db-cf9d-4f29-9088-8cb468d5f912 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:11.233757 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.wsgi [None req-5c7775db-cf9d-4f29-9088-8cb468d5f912 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] HTTP exception thrown: Instance cb177d8b-e293-48e0-ad13-3227f2a2e78a could not be found. May 23 12:34:11.238770 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-5c7775db-cf9d-4f29-9088-8cb468d5f912 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Request method failure captured: May 23 12:34:11.238770 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: request: GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a/os-volume_attachments HTTP/1.1 May 23 12:34:11.238770 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept: application/json May 23 12:34:11.238770 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept-Encoding: identity May 23 12:34:11.238770 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Connection: close May 23 12:34:11.238770 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Length: 0 May 23 12:34:11.238770 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Type: application/json May 23 12:34:11.238770 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Host: 10.222.0.16 May 23 12:34:11.238770 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Openstack-System-Scope: None May 23 12:34:11.238770 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: User-Agent: python-urllib3/1.26.9 May 23 12:34:11.238770 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Auth-Token: gAAAAABii38BTvf7pgHXIPozU6AMkCyc7hA-8_iLCrY6gusv1sIKb5hHxaPXzSC5LTPWJtD1uNlm4Ud702rGrPFGUlF1JsfY-j1Wo_wlpLTO0CF-34Aes-eZpj0udurHWpAHGzBaxrqmTmXTKRpuIly0JQONLg9ALTik1BZ1AtdawV8lKmbyEWs May 23 12:34:11.238770 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Id: None May 23 12:34:11.238770 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Name: None May 23 12:34:11.238770 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Identity-Status: Confirmed May 23 12:34:11.238770 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Is-Admin-Project: True May 23 12:34:11.238770 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Id: default May 23 12:34:11.238770 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Name: Default May 23 12:34:11.238770 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Id: 1f94aad6b61d49da817d70d2b91a7594 May 23 12:34:11.238770 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Name: tempest-DeleteServersTestJSON-259516189 May 23 12:34:11.238770 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Role: member,reader May 23 12:34:11.238770 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Roles: member,reader May 23 12:34:11.240068 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1f94aad6b61d49da817d70d2b91a7594"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1f94aad6b61d49da817d70d2b91a7594"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1f94aad6b61d49da817d70d2b91a7594", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1f94aad6b61d49da817d70d2b91a7594"}]}] May 23 12:34:11.240068 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant: tempest-DeleteServersTestJSON-259516189 May 23 12:34:11.240068 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Id: 1f94aad6b61d49da817d70d2b91a7594 May 23 12:34:11.240068 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Name: tempest-DeleteServersTestJSON-259516189 May 23 12:34:11.240068 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User: tempest-DeleteServersTestJSON-259516189-project May 23 12:34:11.240068 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Id: default May 23 12:34:11.240068 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Name: Default May 23 12:34:11.240068 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Id: f2936fe7026046aa9c43f1b1b0cb1bfd May 23 12:34:11.240068 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Name: tempest-DeleteServersTestJSON-259516189-project May 23 12:34:11.240068 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: method: > May 23 12:34:11.240068 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: exception: Instance cb177d8b-e293-48e0-ad13-3227f2a2e78a could not be found. May 23 12:34:11.240068 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: action_args: {'server_id': 'cb177d8b-e293-48e0-ad13-3227f2a2e78a'} May 23 12:34:11.240747 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:34:11.240747 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:34:11.240747 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:34:11.240747 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:34:11.240747 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:34:11.240747 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:34:11.240747 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:34:11.240747 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:34:11.240747 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:34:11.240747 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:34:11.240747 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb177d8b-e293-48e0-ad13-3227f2a2e78a could not be found. May 23 12:34:11.240747 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:34:11.240747 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:34:11.240747 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:34:11.240747 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:34:11.240747 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:34:11.240747 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:34:11.240747 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:34:11.240747 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:34:11.240747 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:34:11.241761 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:34:11.241761 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 23 12:34:11.241761 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 12:34:11.241761 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 23 12:34:11.241761 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 12:34:11.241761 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 23 12:34:11.241761 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 23 12:34:11.241761 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:34:11.241761 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:34:11.241761 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb177d8b-e293-48e0-ad13-3227f2a2e78a could not be found. May 23 12:34:11.241761 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:34:11.241761 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:34:11.241761 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:34:11.241761 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:34:11.241761 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:34:11.241761 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:34:11.241761 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:34:11.241761 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:34:11.241761 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb177d8b-e293-48e0-ad13-3227f2a2e78a could not be found. May 23 12:34:11.241761 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:34:11.243221 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-5c7775db-cf9d-4f29-9088-8cb468d5f912 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Returning 404 to user: Instance cb177d8b-e293-48e0-ad13-3227f2a2e78a could not be found. {{(pid=124200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:34:11.243221 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-5c7775db-cf9d-4f29-9088-8cb468d5f912 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] 10.222.0.16 "GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.053449 May 23 12:34:11.248094 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 60/116] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 12:34:11 2022] GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a/os-volume_attachments => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 12:34:11.388026 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-5796f48b-09d7-46a6-bef9-144c89d45b60 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:11.404320 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-5796f48b-09d7-46a6-bef9-144c89d45b60 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 200 len: 1548 microversion: 2.1 time: 0.300506 May 23 12:34:11.404926 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 57/117] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:11 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 1548 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:34:11.433722 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-a608f542-b147-4d2f-a8e2-f2b40de069c6 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:11.440095 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-a608f542-b147-4d2f-a8e2-f2b40de069c6 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:11.467502 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a608f542-b147-4d2f-a8e2-f2b40de069c6 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:11.468935 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a608f542-b147-4d2f-a8e2-f2b40de069c6 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:11.470639 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a608f542-b147-4d2f-a8e2-f2b40de069c6 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:11.471627 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a608f542-b147-4d2f-a8e2-f2b40de069c6 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:11.608090 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-a608f542-b147-4d2f-a8e2-f2b40de069c6 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.184001 May 23 12:34:11.608786 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 61/118] 10.222.0.16 () {58 vars in 1274 bytes} [Mon May 23 12:34:11 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e/os-interface => generated 284 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:34:11.703985 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0e296c5a-2e08-4526-8a01-b6b5f72ed02f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:11.704694 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-0e296c5a-2e08-4526-8a01-b6b5f72ed02f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:11.712355 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0e296c5a-2e08-4526-8a01-b6b5f72ed02f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:11.712660 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0e296c5a-2e08-4526-8a01-b6b5f72ed02f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:11.713572 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0e296c5a-2e08-4526-8a01-b6b5f72ed02f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:11.714713 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0e296c5a-2e08-4526-8a01-b6b5f72ed02f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:11.724602 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-33af4c31-2068-4c18-863a-914942d51463 req-04bfdc47-3e75-4725-9658-1b9ebc53536c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6862b746-8558-4cd5-b71a-9a69ad923901", "name": "network-vif-plugged", "status": "completed", "tag": "c4590a1b-944a-40a6-ae11-0a586abe29b8"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:34:11.739418 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-33af4c31-2068-4c18-863a-914942d51463 req-04bfdc47-3e75-4725-9658-1b9ebc53536c service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:11.739866 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-33af4c31-2068-4c18-863a-914942d51463 req-04bfdc47-3e75-4725-9658-1b9ebc53536c service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:11.768859 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-33af4c31-2068-4c18-863a-914942d51463 req-04bfdc47-3e75-4725-9658-1b9ebc53536c service nova] Creating event network-vif-plugged:c4590a1b-944a-40a6-ae11-0a586abe29b8 for instance 6862b746-8558-4cd5-b71a-9a69ad923901 on hv-cinder-83699 May 23 12:34:11.775162 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-33af4c31-2068-4c18-863a-914942d51463 req-04bfdc47-3e75-4725-9658-1b9ebc53536c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053795 May 23 12:34:11.776594 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 62/119] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:34:11.878792 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0e296c5a-2e08-4526-8a01-b6b5f72ed02f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:11.887483 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-0e296c5a-2e08-4526-8a01-b6b5f72ed02f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1321 microversion: 2.1 time: 0.188024 May 23 12:34:11.888159 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 58/120] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:11 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:34:12.728047 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-85378db1-b296-42a0-a5ba-7a2c8dce08f6 req-007ff5f1-7cf9-48db-a672-0c36c16f98ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "380a99e6-38d9-4af6-9fa8-5506a0ffcf5e", "tag": "1c168015-cbd1-4ffe-8cf8-c803d21df858"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:34:12.740383 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-4b4bffd9-0014-41ac-aca4-549563b74d09 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:12.740986 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-4b4bffd9-0014-41ac-aca4-549563b74d09 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] [instance: cb177d8b-e293-48e0-ad13-3227f2a2e78a] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:12.744442 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-85378db1-b296-42a0-a5ba-7a2c8dce08f6 req-007ff5f1-7cf9-48db-a672-0c36c16f98ba service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:12.745290 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-85378db1-b296-42a0-a5ba-7a2c8dce08f6 req-007ff5f1-7cf9-48db-a672-0c36c16f98ba service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:12.749314 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4b4bffd9-0014-41ac-aca4-549563b74d09 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:12.751679 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4b4bffd9-0014-41ac-aca4-549563b74d09 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:12.759720 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4b4bffd9-0014-41ac-aca4-549563b74d09 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:12.760594 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4b4bffd9-0014-41ac-aca4-549563b74d09 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:12.770415 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-85378db1-b296-42a0-a5ba-7a2c8dce08f6 req-007ff5f1-7cf9-48db-a672-0c36c16f98ba service nova] Creating event network-changed:1c168015-cbd1-4ffe-8cf8-c803d21df858 for instance 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e on hv-cinder-83699 May 23 12:34:12.777501 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-85378db1-b296-42a0-a5ba-7a2c8dce08f6 req-007ff5f1-7cf9-48db-a672-0c36c16f98ba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054462 May 23 12:34:12.779215 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 63/121] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:34:12.793539 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.wsgi [None req-4b4bffd9-0014-41ac-aca4-549563b74d09 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] HTTP exception thrown: Instance cb177d8b-e293-48e0-ad13-3227f2a2e78a could not be found. May 23 12:34:12.799246 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-4b4bffd9-0014-41ac-aca4-549563b74d09 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Request method failure captured: May 23 12:34:12.799246 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: request: DELETE /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a HTTP/1.1 May 23 12:34:12.799246 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept: application/json May 23 12:34:12.799246 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept-Encoding: identity May 23 12:34:12.799246 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Connection: close May 23 12:34:12.799246 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Length: 0 May 23 12:34:12.799246 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Type: application/json May 23 12:34:12.799246 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Host: 10.222.0.16 May 23 12:34:12.799246 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Openstack-System-Scope: None May 23 12:34:12.799246 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: User-Agent: python-urllib3/1.26.9 May 23 12:34:12.799246 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Auth-Token: gAAAAABii38BTvf7pgHXIPozU6AMkCyc7hA-8_iLCrY6gusv1sIKb5hHxaPXzSC5LTPWJtD1uNlm4Ud702rGrPFGUlF1JsfY-j1Wo_wlpLTO0CF-34Aes-eZpj0udurHWpAHGzBaxrqmTmXTKRpuIly0JQONLg9ALTik1BZ1AtdawV8lKmbyEWs May 23 12:34:12.799246 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Id: None May 23 12:34:12.799246 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Name: None May 23 12:34:12.799246 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Identity-Status: Confirmed May 23 12:34:12.799246 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Is-Admin-Project: True May 23 12:34:12.799246 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Id: default May 23 12:34:12.799246 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Name: Default May 23 12:34:12.799246 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Id: 1f94aad6b61d49da817d70d2b91a7594 May 23 12:34:12.799246 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Name: tempest-DeleteServersTestJSON-259516189 May 23 12:34:12.799246 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Role: member,reader May 23 12:34:12.799246 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Roles: member,reader May 23 12:34:12.801484 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1f94aad6b61d49da817d70d2b91a7594"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1f94aad6b61d49da817d70d2b91a7594"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1f94aad6b61d49da817d70d2b91a7594", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1f94aad6b61d49da817d70d2b91a7594"}]}] May 23 12:34:12.801484 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant: tempest-DeleteServersTestJSON-259516189 May 23 12:34:12.801484 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Id: 1f94aad6b61d49da817d70d2b91a7594 May 23 12:34:12.801484 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Name: tempest-DeleteServersTestJSON-259516189 May 23 12:34:12.801484 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User: tempest-DeleteServersTestJSON-259516189-project May 23 12:34:12.801484 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Id: default May 23 12:34:12.801484 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Name: Default May 23 12:34:12.801484 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Id: f2936fe7026046aa9c43f1b1b0cb1bfd May 23 12:34:12.801484 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Name: tempest-DeleteServersTestJSON-259516189-project May 23 12:34:12.801484 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: method: > May 23 12:34:12.801484 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: exception: Instance cb177d8b-e293-48e0-ad13-3227f2a2e78a could not be found. May 23 12:34:12.801484 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: action_args: {'id': 'cb177d8b-e293-48e0-ad13-3227f2a2e78a'} May 23 12:34:12.802843 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:34:12.802843 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:34:12.802843 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:34:12.802843 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:34:12.802843 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:34:12.802843 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:34:12.802843 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:34:12.802843 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:34:12.802843 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:34:12.802843 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:34:12.802843 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb177d8b-e293-48e0-ad13-3227f2a2e78a could not be found. May 23 12:34:12.802843 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:34:12.802843 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:34:12.802843 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:34:12.802843 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:34:12.802843 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:34:12.802843 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:34:12.802843 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:34:12.802843 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:34:12.802843 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:34:12.804733 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:34:12.804733 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 12:34:12.804733 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 12:34:12.804733 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 12:34:12.804733 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 12:34:12.804733 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:34:12.804733 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:34:12.804733 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:34:12.804733 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:34:12.804733 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb177d8b-e293-48e0-ad13-3227f2a2e78a could not be found. May 23 12:34:12.804733 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:34:12.804733 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:34:12.804733 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:34:12.804733 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:34:12.804733 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:34:12.804733 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:34:12.804733 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:34:12.804733 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:34:12.804733 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb177d8b-e293-48e0-ad13-3227f2a2e78a could not be found. May 23 12:34:12.804733 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:34:12.808319 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-4b4bffd9-0014-41ac-aca4-549563b74d09 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Returning 404 to user: Instance cb177d8b-e293-48e0-ad13-3227f2a2e78a could not be found. {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:34:12.808319 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-4b4bffd9-0014-41ac-aca4-549563b74d09 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a" status: 404 len: 111 microversion: 2.1 time: 0.064690 May 23 12:34:12.808319 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 59/122] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 12:34:12 2022] DELETE /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:34:12.811467 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-5cfa3e62-aaa9-448d-aa56-0b55dbbbda00 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:12.811467 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-5cfa3e62-aaa9-448d-aa56-0b55dbbbda00 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] [instance: cb177d8b-e293-48e0-ad13-3227f2a2e78a] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:12.817708 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5cfa3e62-aaa9-448d-aa56-0b55dbbbda00 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:12.818157 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5cfa3e62-aaa9-448d-aa56-0b55dbbbda00 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:12.818933 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5cfa3e62-aaa9-448d-aa56-0b55dbbbda00 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:12.819364 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5cfa3e62-aaa9-448d-aa56-0b55dbbbda00 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:12.835421 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.wsgi [None req-5cfa3e62-aaa9-448d-aa56-0b55dbbbda00 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] HTTP exception thrown: Instance cb177d8b-e293-48e0-ad13-3227f2a2e78a could not be found. May 23 12:34:12.842025 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-5cfa3e62-aaa9-448d-aa56-0b55dbbbda00 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Request method failure captured: May 23 12:34:12.842025 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: request: GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a HTTP/1.1 May 23 12:34:12.842025 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept: application/json May 23 12:34:12.842025 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept-Encoding: identity May 23 12:34:12.842025 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Connection: close May 23 12:34:12.842025 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Length: 0 May 23 12:34:12.842025 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Type: application/json May 23 12:34:12.842025 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Host: 10.222.0.16 May 23 12:34:12.842025 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Openstack-System-Scope: None May 23 12:34:12.842025 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: User-Agent: python-urllib3/1.26.9 May 23 12:34:12.842025 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Auth-Token: gAAAAABii38BTvf7pgHXIPozU6AMkCyc7hA-8_iLCrY6gusv1sIKb5hHxaPXzSC5LTPWJtD1uNlm4Ud702rGrPFGUlF1JsfY-j1Wo_wlpLTO0CF-34Aes-eZpj0udurHWpAHGzBaxrqmTmXTKRpuIly0JQONLg9ALTik1BZ1AtdawV8lKmbyEWs May 23 12:34:12.842025 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Id: None May 23 12:34:12.842025 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Name: None May 23 12:34:12.842025 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Identity-Status: Confirmed May 23 12:34:12.842025 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Is-Admin-Project: True May 23 12:34:12.842025 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Id: default May 23 12:34:12.842025 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Name: Default May 23 12:34:12.842025 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Id: 1f94aad6b61d49da817d70d2b91a7594 May 23 12:34:12.842025 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Name: tempest-DeleteServersTestJSON-259516189 May 23 12:34:12.842025 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Role: member,reader May 23 12:34:12.842025 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Roles: member,reader May 23 12:34:12.843326 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1f94aad6b61d49da817d70d2b91a7594"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1f94aad6b61d49da817d70d2b91a7594"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1f94aad6b61d49da817d70d2b91a7594", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1f94aad6b61d49da817d70d2b91a7594"}]}] May 23 12:34:12.843326 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant: tempest-DeleteServersTestJSON-259516189 May 23 12:34:12.843326 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Id: 1f94aad6b61d49da817d70d2b91a7594 May 23 12:34:12.843326 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Name: tempest-DeleteServersTestJSON-259516189 May 23 12:34:12.843326 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User: tempest-DeleteServersTestJSON-259516189-project May 23 12:34:12.843326 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Id: default May 23 12:34:12.843326 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Name: Default May 23 12:34:12.843326 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Id: f2936fe7026046aa9c43f1b1b0cb1bfd May 23 12:34:12.843326 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Name: tempest-DeleteServersTestJSON-259516189-project May 23 12:34:12.843326 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: method: > May 23 12:34:12.843326 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: exception: Instance cb177d8b-e293-48e0-ad13-3227f2a2e78a could not be found. May 23 12:34:12.843326 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: action_args: {'id': 'cb177d8b-e293-48e0-ad13-3227f2a2e78a'} May 23 12:34:12.843969 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:34:12.843969 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:34:12.843969 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:34:12.843969 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:34:12.843969 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:34:12.843969 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:34:12.843969 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:34:12.843969 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:34:12.843969 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:34:12.843969 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:34:12.843969 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb177d8b-e293-48e0-ad13-3227f2a2e78a could not be found. May 23 12:34:12.843969 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:34:12.843969 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:34:12.843969 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:34:12.843969 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:34:12.843969 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:34:12.843969 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:34:12.843969 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:34:12.843969 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:34:12.843969 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:34:12.845063 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:34:12.845063 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:34:12.845063 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:34:12.845063 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:34:12.845063 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:34:12.845063 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:34:12.845063 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:34:12.845063 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb177d8b-e293-48e0-ad13-3227f2a2e78a could not be found. May 23 12:34:12.845063 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:34:12.845063 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:34:12.845063 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:34:12.845063 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:34:12.845063 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:34:12.845063 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:34:12.845063 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:34:12.845063 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:34:12.845063 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb177d8b-e293-48e0-ad13-3227f2a2e78a could not be found. May 23 12:34:12.845063 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:34:12.846023 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-5cfa3e62-aaa9-448d-aa56-0b55dbbbda00 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] Returning 404 to user: Instance cb177d8b-e293-48e0-ad13-3227f2a2e78a could not be found. {{(pid=124200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:34:12.846023 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-5cfa3e62-aaa9-448d-aa56-0b55dbbbda00 tempest-DeleteServersTestJSON-259516189 tempest-DeleteServersTestJSON-259516189-project] 10.222.0.16 "GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a" status: 404 len: 111 microversion: 2.1 time: 0.037550 May 23 12:34:12.847765 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 64/123] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:12 2022] GET /compute/v2.1/servers/cb177d8b-e293-48e0-ad13-3227f2a2e78a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:34:12.910693 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b8241e04-48ca-4db4-89e3-fddfcfeaeb5f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:12.911727 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-b8241e04-48ca-4db4-89e3-fddfcfeaeb5f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:12.922176 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b8241e04-48ca-4db4-89e3-fddfcfeaeb5f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:12.922701 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b8241e04-48ca-4db4-89e3-fddfcfeaeb5f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:12.923497 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b8241e04-48ca-4db4-89e3-fddfcfeaeb5f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:12.923931 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b8241e04-48ca-4db4-89e3-fddfcfeaeb5f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:13.273016 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b8241e04-48ca-4db4-89e3-fddfcfeaeb5f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:13.291414 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b8241e04-48ca-4db4-89e3-fddfcfeaeb5f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1321 microversion: 2.1 time: 0.387593 May 23 12:34:13.292733 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 60/124] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:12 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1321 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:14.309381 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-be6673e8-4c33-4a80-a0b9-9b6c58a180ee tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:14.310728 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-be6673e8-4c33-4a80-a0b9-9b6c58a180ee tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:14.323456 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-be6673e8-4c33-4a80-a0b9-9b6c58a180ee tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:14.324395 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-be6673e8-4c33-4a80-a0b9-9b6c58a180ee tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:14.326089 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-be6673e8-4c33-4a80-a0b9-9b6c58a180ee tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:14.326788 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-be6673e8-4c33-4a80-a0b9-9b6c58a180ee tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:14.481526 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-be6673e8-4c33-4a80-a0b9-9b6c58a180ee tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:14.490004 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-be6673e8-4c33-4a80-a0b9-9b6c58a180ee tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1321 microversion: 2.1 time: 0.184970 May 23 12:34:14.490575 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 65/125] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:14 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:15.221249 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b9fedae5-5d98-4553-a961-7d5c2e19a884 tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] Action: 'create', calling method: .version_select at 0x7f095d5e2d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1717898376"}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:34:15.507383 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-5311ba43-6929-466c-bc09-1931407a4d73 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:15.508662 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-5311ba43-6929-466c-bc09-1931407a4d73 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:15.517318 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5311ba43-6929-466c-bc09-1931407a4d73 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:15.517318 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5311ba43-6929-466c-bc09-1931407a4d73 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:15.518004 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5311ba43-6929-466c-bc09-1931407a4d73 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:15.518438 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5311ba43-6929-466c-bc09-1931407a4d73 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:15.549851 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b9fedae5-5d98-4553-a961-7d5c2e19a884 tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.461606 May 23 12:34:15.550482 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 61/126] 10.222.0.16 () {60 vars in 1154 bytes} [Mon May 23 12:34:15 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 463 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 23 12:34:15.564785 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b03453cf-ee25-42ea-85b7-3a53b528d332 tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] Calling method '.version_select at 0x7f095d44be50>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:15.634474 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b03453cf-ee25-42ea-85b7-3a53b528d332 tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/82d887bd-9346-4f05-a5f1-91c783369225" status: 200 len: 345 microversion: 2.1 time: 0.075198 May 23 12:34:15.636588 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 62/127] 10.222.0.16 () {58 vars in 1244 bytes} [Mon May 23 12:34:15 2022] GET /compute/v2.1/os-volumes/82d887bd-9346-4f05-a5f1-91c783369225 => generated 345 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:34:15.691894 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-5311ba43-6929-466c-bc09-1931407a4d73 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:15.699963 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-5311ba43-6929-466c-bc09-1931407a4d73 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1321 microversion: 2.1 time: 0.196868 May 23 12:34:15.700866 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 66/128] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:15 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1321 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:16.646154 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-6847818f-f62a-4a6b-b0eb-1ef2b3b1672e tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] Calling method '.version_select at 0x7f095d427f70>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:16.696156 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-6847818f-f62a-4a6b-b0eb-1ef2b3b1672e tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/82d887bd-9346-4f05-a5f1-91c783369225" status: 200 len: 345 microversion: 2.1 time: 0.053216 May 23 12:34:16.696818 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 63/129] 10.222.0.16 () {58 vars in 1244 bytes} [Mon May 23 12:34:16 2022] GET /compute/v2.1/os-volumes/82d887bd-9346-4f05-a5f1-91c783369225 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:34:16.717323 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-5525cba9-7ccc-4355-912c-41a8ceba2419 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:16.717954 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-5525cba9-7ccc-4355-912c-41a8ceba2419 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:16.724918 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5525cba9-7ccc-4355-912c-41a8ceba2419 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:16.725386 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5525cba9-7ccc-4355-912c-41a8ceba2419 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:16.726571 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5525cba9-7ccc-4355-912c-41a8ceba2419 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:16.726571 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5525cba9-7ccc-4355-912c-41a8ceba2419 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:16.871959 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-5525cba9-7ccc-4355-912c-41a8ceba2419 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:16.880464 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-5525cba9-7ccc-4355-912c-41a8ceba2419 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1321 microversion: 2.1 time: 0.166944 May 23 12:34:16.881042 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 67/130] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:16 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:34:17.709757 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-1838642f-37a3-4cf2-b90d-3b2d671c6150 tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] Calling method '.version_select at 0x7f095d5e28b0>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:17.761921 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-1838642f-37a3-4cf2-b90d-3b2d671c6150 tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/82d887bd-9346-4f05-a5f1-91c783369225" status: 200 len: 346 microversion: 2.1 time: 0.056428 May 23 12:34:17.762567 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 64/131] 10.222.0.16 () {58 vars in 1244 bytes} [Mon May 23 12:34:17 2022] GET /compute/v2.1/os-volumes/82d887bd-9346-4f05-a5f1-91c783369225 => generated 346 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:34:17.775162 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-2a780730-3ffb-466d-8c2b-c06ebe5cf7eb tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] Action: 'create', calling method: .version_select at 0x7f095cce6430>, body: {"snapshot": {"volume_id": "82d887bd-9346-4f05-a5f1-91c783369225", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2139252509"}} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:34:17.900344 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-4d8930e5-861c-411b-a6d9-0f0e22c8ecfb tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:17.900959 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-4d8930e5-861c-411b-a6d9-0f0e22c8ecfb tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:17.907526 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4d8930e5-861c-411b-a6d9-0f0e22c8ecfb tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:17.908015 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4d8930e5-861c-411b-a6d9-0f0e22c8ecfb tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:17.908837 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4d8930e5-861c-411b-a6d9-0f0e22c8ecfb tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:17.909272 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4d8930e5-861c-411b-a6d9-0f0e22c8ecfb tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:17.952324 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-2a780730-3ffb-466d-8c2b-c06ebe5cf7eb tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] 10.222.0.16 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.182123 May 23 12:34:17.953051 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 68/132] 10.222.0.16 () {60 vars in 1161 bytes} [Mon May 23 12:34:17 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:34:17.965642 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-14e248dd-bba4-4904-8370-c90d231a7189 tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] Calling method '.version_select at 0x7f095cc550d0>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:18.001348 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-14e248dd-bba4-4904-8370-c90d231a7189 tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/251af460-40f3-4ed2-b49d-5071b2b3593d" status: 200 len: 287 microversion: 2.1 time: 0.040874 May 23 12:34:18.001998 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 69/133] 10.222.0.16 () {58 vars in 1250 bytes} [Mon May 23 12:34:17 2022] GET /compute/v2.1/os-snapshots/251af460-40f3-4ed2-b49d-5071b2b3593d => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:34:18.013418 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-6848cdb5-cdeb-4bda-8626-e3cf7c7e35a9 tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] Calling method '.version_select at 0x7f095cc555e0>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:18.058904 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-6848cdb5-cdeb-4bda-8626-e3cf7c7e35a9 tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.049157 May 23 12:34:18.059484 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 70/134] 10.222.0.16 () {58 vars in 1139 bytes} [Mon May 23 12:34:18 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:34:18.069737 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-16fb7b2d-b246-4b27-a0ac-e7196a05b998 tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] Calling method '.version_select at 0x7f095cce61f0>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:18.076975 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-4d8930e5-861c-411b-a6d9-0f0e22c8ecfb tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:18.085006 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-4d8930e5-861c-411b-a6d9-0f0e22c8ecfb tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1515 microversion: 2.1 time: 0.189073 May 23 12:34:18.085580 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 65/135] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:17 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1515 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:34:18.103936 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-2b4fb5c4-e97d-4d9b-8cfc-33a4f0363f41 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:34:18.104867 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-16fb7b2d-b246-4b27-a0ac-e7196a05b998 tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/251af460-40f3-4ed2-b49d-5071b2b3593d" status: 200 len: 287 microversion: 2.1 time: 0.039016 May 23 12:34:18.105008 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-2b4fb5c4-e97d-4d9b-8cfc-33a4f0363f41 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:18.105605 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 71/136] 10.222.0.16 () {58 vars in 1250 bytes} [Mon May 23 12:34:18 2022] GET /compute/v2.1/os-snapshots/251af460-40f3-4ed2-b49d-5071b2b3593d => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:34:18.111253 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2b4fb5c4-e97d-4d9b-8cfc-33a4f0363f41 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:18.111696 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2b4fb5c4-e97d-4d9b-8cfc-33a4f0363f41 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:18.112534 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2b4fb5c4-e97d-4d9b-8cfc-33a4f0363f41 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:18.112985 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2b4fb5c4-e97d-4d9b-8cfc-33a4f0363f41 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:18.139624 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.objects.instance [None req-2b4fb5c4-e97d-4d9b-8cfc-33a4f0363f41 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lazy-loading 'flavor' on Instance uuid 6862b746-8558-4cd5-b71a-9a69ad923901 {{(pid=124199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:34:18.267451 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-2b4fb5c4-e97d-4d9b-8cfc-33a4f0363f41 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "POST /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901/action" status: 200 len: 32 microversion: 2.1 time: 0.167609 May 23 12:34:18.268194 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 66/137] 10.222.0.16 () {60 vars in 1277 bytes} [Mon May 23 12:34:18 2022] POST /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901/action => generated 32 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 12:34:18.278669 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-938f6fac-94ae-4f33-9395-5527f64a5d39 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:18.279288 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-938f6fac-94ae-4f33-9395-5527f64a5d39 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:18.285516 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-938f6fac-94ae-4f33-9395-5527f64a5d39 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:18.285967 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-938f6fac-94ae-4f33-9395-5527f64a5d39 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:18.287493 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-938f6fac-94ae-4f33-9395-5527f64a5d39 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:18.288033 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-938f6fac-94ae-4f33-9395-5527f64a5d39 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:18.427794 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-938f6fac-94ae-4f33-9395-5527f64a5d39 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:18.436135 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-938f6fac-94ae-4f33-9395-5527f64a5d39 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1521 microversion: 2.1 time: 0.162510 May 23 12:34:18.436753 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 72/138] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:18 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:19.117083 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-aa959754-2aed-4563-adab-35346e6f86e9 tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] Calling method '.version_select at 0x7f095d44b430>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:19.147769 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-aa959754-2aed-4563-adab-35346e6f86e9 tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/251af460-40f3-4ed2-b49d-5071b2b3593d" status: 200 len: 287 microversion: 2.1 time: 0.034955 May 23 12:34:19.148435 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 67/139] 10.222.0.16 () {58 vars in 1250 bytes} [Mon May 23 12:34:19 2022] GET /compute/v2.1/os-snapshots/251af460-40f3-4ed2-b49d-5071b2b3593d => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:34:19.454764 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-d56d4e13-edd4-4b29-a38f-573f1812bf60 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:19.455367 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-d56d4e13-edd4-4b29-a38f-573f1812bf60 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:19.462879 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d56d4e13-edd4-4b29-a38f-573f1812bf60 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:19.463323 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d56d4e13-edd4-4b29-a38f-573f1812bf60 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:19.464105 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d56d4e13-edd4-4b29-a38f-573f1812bf60 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:19.464635 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d56d4e13-edd4-4b29-a38f-573f1812bf60 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:19.602533 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-d56d4e13-edd4-4b29-a38f-573f1812bf60 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:19.611480 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-d56d4e13-edd4-4b29-a38f-573f1812bf60 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1521 microversion: 2.1 time: 0.160714 May 23 12:34:19.612155 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 73/140] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:19 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:20.160199 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-e53de183-27bd-40ec-ba35-36c2f8155da8 tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] Calling method '.version_select at 0x7f095d44bc10>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:20.199715 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-e53de183-27bd-40ec-ba35-36c2f8155da8 tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/251af460-40f3-4ed2-b49d-5071b2b3593d" status: 200 len: 287 microversion: 2.1 time: 0.043388 May 23 12:34:20.200624 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 68/141] 10.222.0.16 () {58 vars in 1250 bytes} [Mon May 23 12:34:20 2022] GET /compute/v2.1/os-snapshots/251af460-40f3-4ed2-b49d-5071b2b3593d => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:34:20.629866 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-1dd6b148-e0bb-454a-9972-34c2d4d34a01 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:20.630784 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-1dd6b148-e0bb-454a-9972-34c2d4d34a01 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:20.641729 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1dd6b148-e0bb-454a-9972-34c2d4d34a01 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:20.641729 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1dd6b148-e0bb-454a-9972-34c2d4d34a01 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:20.641729 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1dd6b148-e0bb-454a-9972-34c2d4d34a01 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:20.641729 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1dd6b148-e0bb-454a-9972-34c2d4d34a01 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:20.781490 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-1dd6b148-e0bb-454a-9972-34c2d4d34a01 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:20.790822 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-1dd6b148-e0bb-454a-9972-34c2d4d34a01 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1521 microversion: 2.1 time: 0.164675 May 23 12:34:20.791494 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 74/142] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:20 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:21.212204 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-785734a0-7af4-43c2-a621-111d240f381b tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] Calling method '.version_select at 0x7f095d44baf0>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:21.247520 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-785734a0-7af4-43c2-a621-111d240f381b tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/251af460-40f3-4ed2-b49d-5071b2b3593d" status: 200 len: 287 microversion: 2.1 time: 0.039845 May 23 12:34:21.251601 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 69/143] 10.222.0.16 () {58 vars in 1250 bytes} [Mon May 23 12:34:21 2022] GET /compute/v2.1/os-snapshots/251af460-40f3-4ed2-b49d-5071b2b3593d => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:34:21.810231 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-b799c792-9e76-4f27-9cd6-5b3c7954a0aa tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:21.811031 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-b799c792-9e76-4f27-9cd6-5b3c7954a0aa tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:21.818595 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b799c792-9e76-4f27-9cd6-5b3c7954a0aa tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:21.819046 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b799c792-9e76-4f27-9cd6-5b3c7954a0aa tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:21.819828 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b799c792-9e76-4f27-9cd6-5b3c7954a0aa tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:21.820297 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b799c792-9e76-4f27-9cd6-5b3c7954a0aa tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:21.967130 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-b799c792-9e76-4f27-9cd6-5b3c7954a0aa tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:21.975472 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-b799c792-9e76-4f27-9cd6-5b3c7954a0aa tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1521 microversion: 2.1 time: 0.169597 May 23 12:34:21.976062 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 75/144] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:21 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:22.265545 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b1d23641-bfb5-4230-a87b-370276d697c1 tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] Calling method '.version_select at 0x7f095d44bee0>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:22.308920 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b1d23641-bfb5-4230-a87b-370276d697c1 tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/251af460-40f3-4ed2-b49d-5071b2b3593d" status: 200 len: 288 microversion: 2.1 time: 0.051298 May 23 12:34:22.309458 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 70/145] 10.222.0.16 () {58 vars in 1250 bytes} [Mon May 23 12:34:22 2022] GET /compute/v2.1/os-snapshots/251af460-40f3-4ed2-b49d-5071b2b3593d => generated 288 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:34:22.320580 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-44e01da8-5a68-47fe-957a-6f05785a4938 tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] Calling method '.version_select at 0x7f095cd8f040>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:22.421520 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-44e01da8-5a68-47fe-957a-6f05785a4938 tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] 10.222.0.16 "DELETE /compute/v2.1/os-snapshots/251af460-40f3-4ed2-b49d-5071b2b3593d" status: 202 len: 0 microversion: 2.1 time: 0.105583 May 23 12:34:22.422095 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 76/146] 10.222.0.16 () {58 vars in 1253 bytes} [Mon May 23 12:34:22 2022] DELETE /compute/v2.1/os-snapshots/251af460-40f3-4ed2-b49d-5071b2b3593d => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 12:34:22.432761 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d493fc5b-fa70-4ff6-899e-ddce71b8ed0a tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] Calling method '.version_select at 0x7f095d427b80>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:22.477283 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d493fc5b-fa70-4ff6-899e-ddce71b8ed0a tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/251af460-40f3-4ed2-b49d-5071b2b3593d" status: 200 len: 287 microversion: 2.1 time: 0.050084 May 23 12:34:22.478300 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 71/147] 10.222.0.16 () {58 vars in 1250 bytes} [Mon May 23 12:34:22 2022] GET /compute/v2.1/os-snapshots/251af460-40f3-4ed2-b49d-5071b2b3593d => generated 287 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:34:22.993699 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-034d7c8d-d789-4dcb-9cf4-2c9951c7bdfc tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:22.994355 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-034d7c8d-d789-4dcb-9cf4-2c9951c7bdfc tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:23.001538 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-034d7c8d-d789-4dcb-9cf4-2c9951c7bdfc tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:23.001882 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-034d7c8d-d789-4dcb-9cf4-2c9951c7bdfc tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:23.002662 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-034d7c8d-d789-4dcb-9cf4-2c9951c7bdfc tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:23.003099 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-034d7c8d-d789-4dcb-9cf4-2c9951c7bdfc tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:23.157013 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-034d7c8d-d789-4dcb-9cf4-2c9951c7bdfc tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:23.165387 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-034d7c8d-d789-4dcb-9cf4-2c9951c7bdfc tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1521 microversion: 2.1 time: 0.175809 May 23 12:34:23.166199 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 77/148] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:22 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:34:23.489478 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-6e79ad4f-8303-41bc-b00b-cadf55ab0bf0 tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] Calling method '.version_select at 0x7f095d5381f0>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:23.520210 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.wsgi [None req-6e79ad4f-8303-41bc-b00b-cadf55ab0bf0 tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] HTTP exception thrown: Snapshot 251af460-40f3-4ed2-b49d-5071b2b3593d could not be found. May 23 12:34:23.525273 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-6e79ad4f-8303-41bc-b00b-cadf55ab0bf0 tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] Request method failure captured: May 23 12:34:23.525273 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: request: GET /compute/v2.1/os-snapshots/251af460-40f3-4ed2-b49d-5071b2b3593d HTTP/1.1 May 23 12:34:23.525273 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept: application/json May 23 12:34:23.525273 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept-Encoding: identity May 23 12:34:23.525273 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Connection: close May 23 12:34:23.525273 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Length: 0 May 23 12:34:23.525273 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Type: application/json May 23 12:34:23.525273 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Host: 10.222.0.16 May 23 12:34:23.525273 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Openstack-System-Scope: None May 23 12:34:23.525273 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: User-Agent: python-urllib3/1.26.9 May 23 12:34:23.525273 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Auth-Token: gAAAAABii39HReuV-9ekERyUm0FLzXtYSFhxINOEwoF5JDXvLiYe-TH5eUPb3zYovNv_9dKieRnWPlosNK8m4w5XR94gGKfMnxtwojSg9si6ltdOYtO5gz0ReRy_W0zBWyao_XiIR2wtOxSKxAIGqqDJGkOM8mhIR1ou5JW48Ggi-pVa1NlG5H8 May 23 12:34:23.525273 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Id: None May 23 12:34:23.525273 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Name: None May 23 12:34:23.525273 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Identity-Status: Confirmed May 23 12:34:23.525273 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Is-Admin-Project: True May 23 12:34:23.525273 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Id: default May 23 12:34:23.525273 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Name: Default May 23 12:34:23.525273 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Id: 0b37b025b98d44eeb774bff2638fc48f May 23 12:34:23.525273 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1618264140 May 23 12:34:23.525273 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Role: member,reader May 23 12:34:23.525273 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Roles: member,reader May 23 12:34:23.526779 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0b37b025b98d44eeb774bff2638fc48f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0b37b025b98d44eeb774bff2638fc48f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0b37b025b98d44eeb774bff2638fc48f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0b37b025b98d44eeb774bff2638fc48f"}]}] May 23 12:34:23.526779 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1618264140 May 23 12:34:23.526779 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Id: 0b37b025b98d44eeb774bff2638fc48f May 23 12:34:23.526779 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1618264140 May 23 12:34:23.526779 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User: tempest-VolumesSnapshotsTestJSON-1618264140-project May 23 12:34:23.526779 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Id: default May 23 12:34:23.526779 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Name: Default May 23 12:34:23.526779 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Id: d58a8eb34c3c46f18d88d1be6e720e23 May 23 12:34:23.526779 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1618264140-project May 23 12:34:23.526779 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: method: May 23 12:34:23.526779 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: exception: Snapshot 251af460-40f3-4ed2-b49d-5071b2b3593d could not be found. May 23 12:34:23.526779 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: action_args: {'id': '251af460-40f3-4ed2-b49d-5071b2b3593d'} May 23 12:34:23.526779 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:34:23.527674 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:34:23.527674 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 23 12:34:23.527674 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 23 12:34:23.527674 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 23 12:34:23.527674 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 23 12:34:23.527674 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 23 12:34:23.527674 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 23 12:34:23.527674 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 12:34:23.527674 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 12:34:23.527674 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 12:34:23.527674 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 12:34:23.527674 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 12:34:23.527674 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 12:34:23.527674 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 12:34:23.527674 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 12:34:23.527674 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 251af460-40f3-4ed2-b49d-5071b2b3593d could not be found. (HTTP 404) (Request-ID: req-4cbee666-385a-4394-9bf8-7ed31d0cc551) May 23 12:34:23.527674 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:34:23.527674 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:34:23.529308 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:34:23.529308 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:34:23.529308 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 23 12:34:23.529308 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 23 12:34:23.529308 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 12:34:23.529308 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 12:34:23.529308 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 23 12:34:23.529308 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 23 12:34:23.529308 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 12:34:23.529308 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 12:34:23.529308 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 23 12:34:23.529308 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 23 12:34:23.529308 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 23 12:34:23.529308 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 23 12:34:23.529308 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 23 12:34:23.529308 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 23 12:34:23.529308 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 12:34:23.529308 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 12:34:23.529308 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 12:34:23.531021 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 12:34:23.531021 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 12:34:23.531021 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 12:34:23.531021 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 12:34:23.531021 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 12:34:23.531021 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 251af460-40f3-4ed2-b49d-5071b2b3593d could not be found. May 23 12:34:23.531021 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:34:23.531021 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:34:23.531021 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:34:23.531021 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:34:23.531021 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:34:23.531021 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:34:23.531021 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:34:23.531021 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:34:23.531021 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 12:34:23.531021 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 12:34:23.531021 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:34:23.531021 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:34:23.531021 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 23 12:34:23.531021 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:34:23.532601 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 251af460-40f3-4ed2-b49d-5071b2b3593d could not be found. May 23 12:34:23.532601 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:34:23.532601 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:34:23.532601 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:34:23.532601 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:34:23.532601 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:34:23.532601 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:34:23.532601 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:34:23.532601 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:34:23.532601 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 251af460-40f3-4ed2-b49d-5071b2b3593d could not be found. May 23 12:34:23.532601 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:34:23.532601 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-6e79ad4f-8303-41bc-b00b-cadf55ab0bf0 tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] Returning 404 to user: Snapshot 251af460-40f3-4ed2-b49d-5071b2b3593d could not be found. {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:34:23.532601 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-6e79ad4f-8303-41bc-b00b-cadf55ab0bf0 tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/251af460-40f3-4ed2-b49d-5071b2b3593d" status: 404 len: 111 microversion: 2.1 time: 0.041390 May 23 12:34:23.534240 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 72/149] 10.222.0.16 () {58 vars in 1250 bytes} [Mon May 23 12:34:23 2022] GET /compute/v2.1/os-snapshots/251af460-40f3-4ed2-b49d-5071b2b3593d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:34:23.535533 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-58161f06-0a86-49a5-9526-e10c329ce4fd tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] Calling method '.version_select at 0x7f095f672ca0>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:23.606839 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-58161f06-0a86-49a5-9526-e10c329ce4fd tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/82d887bd-9346-4f05-a5f1-91c783369225" status: 202 len: 0 microversion: 2.1 time: 0.075063 May 23 12:34:23.607414 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 78/150] 10.222.0.16 () {58 vars in 1247 bytes} [Mon May 23 12:34:23 2022] DELETE /compute/v2.1/os-volumes/82d887bd-9346-4f05-a5f1-91c783369225 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 12:34:23.618891 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-920253c8-3301-4f1b-b23b-e1451c5e5378 tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] Calling method '.version_select at 0x7f095d538280>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:23.686007 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-920253c8-3301-4f1b-b23b-e1451c5e5378 tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/82d887bd-9346-4f05-a5f1-91c783369225" status: 200 len: 345 microversion: 2.1 time: 0.072854 May 23 12:34:23.686628 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 73/151] 10.222.0.16 () {58 vars in 1244 bytes} [Mon May 23 12:34:23 2022] GET /compute/v2.1/os-volumes/82d887bd-9346-4f05-a5f1-91c783369225 => generated 345 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:34:24.185062 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-7f2c0fe1-a999-4ad8-912e-a0ff689dc3b2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:24.186455 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-7f2c0fe1-a999-4ad8-912e-a0ff689dc3b2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:24.197405 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7f2c0fe1-a999-4ad8-912e-a0ff689dc3b2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:24.198050 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7f2c0fe1-a999-4ad8-912e-a0ff689dc3b2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:24.199443 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7f2c0fe1-a999-4ad8-912e-a0ff689dc3b2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:24.200280 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7f2c0fe1-a999-4ad8-912e-a0ff689dc3b2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:24.403824 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-7f2c0fe1-a999-4ad8-912e-a0ff689dc3b2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:24.406425 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell1:SELECT=100 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:24.414615 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-7f2c0fe1-a999-4ad8-912e-a0ff689dc3b2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1521 microversion: 2.1 time: 0.235430 May 23 12:34:24.415256 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 79/152] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:24 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:24.699213 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-fe78927a-cd6f-44c9-a1a6-43e6dbf8cb4a tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] Calling method '.version_select at 0x7f095d538b80>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:24.733570 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.wsgi [None req-fe78927a-cd6f-44c9-a1a6-43e6dbf8cb4a tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] HTTP exception thrown: Volume 82d887bd-9346-4f05-a5f1-91c783369225 could not be found. May 23 12:34:24.735291 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-fe78927a-cd6f-44c9-a1a6-43e6dbf8cb4a tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] Request method failure captured: May 23 12:34:24.735291 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: request: GET /compute/v2.1/os-volumes/82d887bd-9346-4f05-a5f1-91c783369225 HTTP/1.1 May 23 12:34:24.735291 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept: application/json May 23 12:34:24.735291 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept-Encoding: identity May 23 12:34:24.735291 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Connection: close May 23 12:34:24.735291 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Length: 0 May 23 12:34:24.735291 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Type: application/json May 23 12:34:24.735291 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Host: 10.222.0.16 May 23 12:34:24.735291 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Openstack-System-Scope: None May 23 12:34:24.735291 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: User-Agent: python-urllib3/1.26.9 May 23 12:34:24.735291 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Auth-Token: gAAAAABii39HReuV-9ekERyUm0FLzXtYSFhxINOEwoF5JDXvLiYe-TH5eUPb3zYovNv_9dKieRnWPlosNK8m4w5XR94gGKfMnxtwojSg9si6ltdOYtO5gz0ReRy_W0zBWyao_XiIR2wtOxSKxAIGqqDJGkOM8mhIR1ou5JW48Ggi-pVa1NlG5H8 May 23 12:34:24.735291 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Id: None May 23 12:34:24.735291 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Name: None May 23 12:34:24.735291 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Identity-Status: Confirmed May 23 12:34:24.735291 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Is-Admin-Project: True May 23 12:34:24.735291 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Id: default May 23 12:34:24.735291 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Name: Default May 23 12:34:24.735291 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Id: 0b37b025b98d44eeb774bff2638fc48f May 23 12:34:24.735291 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1618264140 May 23 12:34:24.735291 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Role: member,reader May 23 12:34:24.735291 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Roles: member,reader May 23 12:34:24.736737 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0b37b025b98d44eeb774bff2638fc48f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0b37b025b98d44eeb774bff2638fc48f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0b37b025b98d44eeb774bff2638fc48f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0b37b025b98d44eeb774bff2638fc48f"}]}] May 23 12:34:24.736737 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1618264140 May 23 12:34:24.736737 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Id: 0b37b025b98d44eeb774bff2638fc48f May 23 12:34:24.736737 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1618264140 May 23 12:34:24.736737 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User: tempest-VolumesSnapshotsTestJSON-1618264140-project May 23 12:34:24.736737 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Id: default May 23 12:34:24.736737 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Name: Default May 23 12:34:24.736737 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Id: d58a8eb34c3c46f18d88d1be6e720e23 May 23 12:34:24.736737 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1618264140-project May 23 12:34:24.736737 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: method: May 23 12:34:24.736737 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: exception: Volume 82d887bd-9346-4f05-a5f1-91c783369225 could not be found. May 23 12:34:24.736737 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: action_args: {'id': '82d887bd-9346-4f05-a5f1-91c783369225'} May 23 12:34:24.736737 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:34:24.737599 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:34:24.737599 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 12:34:24.737599 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 12:34:24.737599 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 12:34:24.737599 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 12:34:24.737599 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 12:34:24.737599 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 12:34:24.737599 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 12:34:24.737599 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 12:34:24.737599 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 12:34:24.737599 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 12:34:24.737599 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 12:34:24.737599 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 12:34:24.737599 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 12:34:24.737599 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 12:34:24.737599 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 82d887bd-9346-4f05-a5f1-91c783369225 could not be found. (HTTP 404) (Request-ID: req-53a551d0-d3c9-4761-9fd0-5218cc3e19b0) May 23 12:34:24.737599 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:34:24.737599 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:34:24.737599 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:34:24.738834 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:34:24.738834 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 23 12:34:24.738834 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 23 12:34:24.738834 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 12:34:24.738834 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 12:34:24.738834 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 12:34:24.738834 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 12:34:24.738834 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 12:34:24.738834 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 12:34:24.738834 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 12:34:24.738834 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 12:34:24.738834 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 12:34:24.738834 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 12:34:24.738834 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 12:34:24.738834 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 12:34:24.738834 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 12:34:24.738834 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 12:34:24.738834 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 12:34:24.738834 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 12:34:24.741283 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 12:34:24.741283 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 12:34:24.741283 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 12:34:24.741283 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 12:34:24.741283 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 82d887bd-9346-4f05-a5f1-91c783369225 could not be found. May 23 12:34:24.741283 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:34:24.741283 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:34:24.741283 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:34:24.741283 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:34:24.741283 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:34:24.741283 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:34:24.741283 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:34:24.741283 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:34:24.741283 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 12:34:24.741283 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 12:34:24.741283 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:34:24.741283 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:34:24.741283 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 23 12:34:24.741283 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:34:24.743754 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 82d887bd-9346-4f05-a5f1-91c783369225 could not be found. May 23 12:34:24.743754 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:34:24.743754 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:34:24.743754 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:34:24.743754 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:34:24.743754 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:34:24.743754 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:34:24.743754 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:34:24.743754 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:34:24.743754 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 82d887bd-9346-4f05-a5f1-91c783369225 could not be found. May 23 12:34:24.743754 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:34:24.743754 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-fe78927a-cd6f-44c9-a1a6-43e6dbf8cb4a tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] Returning 404 to user: Volume 82d887bd-9346-4f05-a5f1-91c783369225 could not be found. {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:34:24.743754 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-fe78927a-cd6f-44c9-a1a6-43e6dbf8cb4a tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/82d887bd-9346-4f05-a5f1-91c783369225" status: 404 len: 109 microversion: 2.1 time: 0.042236 May 23 12:34:24.743754 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 74/153] 10.222.0.16 () {58 vars in 1244 bytes} [Mon May 23 12:34:24 2022] GET /compute/v2.1/os-volumes/82d887bd-9346-4f05-a5f1-91c783369225 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:34:24.754183 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-7083d028-20c5-4c53-bfca-f7ebc4ecc10d tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] Calling method '.version_select at 0x7f095ef33310>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:24.795216 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.wsgi [None req-7083d028-20c5-4c53-bfca-f7ebc4ecc10d tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] HTTP exception thrown: Volume 82d887bd-9346-4f05-a5f1-91c783369225 could not be found. May 23 12:34:24.798425 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-7083d028-20c5-4c53-bfca-f7ebc4ecc10d tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] Request method failure captured: May 23 12:34:24.798425 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: request: DELETE /compute/v2.1/os-volumes/82d887bd-9346-4f05-a5f1-91c783369225 HTTP/1.1 May 23 12:34:24.798425 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept: application/json May 23 12:34:24.798425 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept-Encoding: identity May 23 12:34:24.798425 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Connection: close May 23 12:34:24.798425 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Length: 0 May 23 12:34:24.798425 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Type: application/json May 23 12:34:24.798425 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Host: 10.222.0.16 May 23 12:34:24.798425 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Openstack-System-Scope: None May 23 12:34:24.798425 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: User-Agent: python-urllib3/1.26.9 May 23 12:34:24.798425 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Auth-Token: gAAAAABii39HReuV-9ekERyUm0FLzXtYSFhxINOEwoF5JDXvLiYe-TH5eUPb3zYovNv_9dKieRnWPlosNK8m4w5XR94gGKfMnxtwojSg9si6ltdOYtO5gz0ReRy_W0zBWyao_XiIR2wtOxSKxAIGqqDJGkOM8mhIR1ou5JW48Ggi-pVa1NlG5H8 May 23 12:34:24.798425 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Id: None May 23 12:34:24.798425 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Name: None May 23 12:34:24.798425 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Identity-Status: Confirmed May 23 12:34:24.798425 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Is-Admin-Project: True May 23 12:34:24.798425 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Id: default May 23 12:34:24.798425 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Name: Default May 23 12:34:24.798425 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Id: 0b37b025b98d44eeb774bff2638fc48f May 23 12:34:24.798425 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1618264140 May 23 12:34:24.798425 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Role: member,reader May 23 12:34:24.798425 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Roles: member,reader May 23 12:34:24.799612 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0b37b025b98d44eeb774bff2638fc48f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0b37b025b98d44eeb774bff2638fc48f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0b37b025b98d44eeb774bff2638fc48f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0b37b025b98d44eeb774bff2638fc48f"}]}] May 23 12:34:24.799612 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1618264140 May 23 12:34:24.799612 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Id: 0b37b025b98d44eeb774bff2638fc48f May 23 12:34:24.799612 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1618264140 May 23 12:34:24.799612 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User: tempest-VolumesSnapshotsTestJSON-1618264140-project May 23 12:34:24.799612 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Id: default May 23 12:34:24.799612 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Name: Default May 23 12:34:24.799612 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Id: d58a8eb34c3c46f18d88d1be6e720e23 May 23 12:34:24.799612 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1618264140-project May 23 12:34:24.799612 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: method: May 23 12:34:24.799612 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: exception: Volume 82d887bd-9346-4f05-a5f1-91c783369225 could not be found. May 23 12:34:24.799612 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: action_args: {'id': '82d887bd-9346-4f05-a5f1-91c783369225'} May 23 12:34:24.799612 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:34:24.800458 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:34:24.800458 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 12:34:24.800458 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 12:34:24.800458 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 12:34:24.800458 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 12:34:24.800458 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 12:34:24.800458 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 12:34:24.800458 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 12:34:24.800458 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 12:34:24.800458 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 12:34:24.800458 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 12:34:24.800458 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 12:34:24.800458 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 12:34:24.800458 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 12:34:24.800458 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 12:34:24.800458 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 82d887bd-9346-4f05-a5f1-91c783369225 could not be found. (HTTP 404) (Request-ID: req-25db14ba-4aae-4d17-88b0-9056aa154070) May 23 12:34:24.800458 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:34:24.800458 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:34:24.800458 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:34:24.801752 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:34:24.801752 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 23 12:34:24.801752 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 23 12:34:24.801752 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 12:34:24.801752 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 12:34:24.801752 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 12:34:24.801752 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 12:34:24.801752 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 12:34:24.801752 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 12:34:24.801752 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 12:34:24.801752 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 12:34:24.801752 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 12:34:24.801752 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 12:34:24.801752 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 12:34:24.801752 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 12:34:24.801752 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 12:34:24.801752 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 12:34:24.801752 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 12:34:24.801752 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 12:34:24.802988 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 12:34:24.802988 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 12:34:24.802988 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 12:34:24.802988 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 12:34:24.802988 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 82d887bd-9346-4f05-a5f1-91c783369225 could not be found. May 23 12:34:24.802988 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:34:24.802988 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:34:24.802988 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:34:24.802988 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:34:24.802988 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:34:24.802988 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:34:24.802988 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:34:24.802988 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:34:24.802988 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 12:34:24.802988 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 12:34:24.802988 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:34:24.802988 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:34:24.802988 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 23 12:34:24.802988 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:34:24.805665 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 82d887bd-9346-4f05-a5f1-91c783369225 could not be found. May 23 12:34:24.805665 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:34:24.805665 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:34:24.805665 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:34:24.805665 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:34:24.805665 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:34:24.805665 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:34:24.805665 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:34:24.805665 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:34:24.805665 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 82d887bd-9346-4f05-a5f1-91c783369225 could not be found. May 23 12:34:24.805665 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:34:24.805665 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-7083d028-20c5-4c53-bfca-f7ebc4ecc10d tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] Returning 404 to user: Volume 82d887bd-9346-4f05-a5f1-91c783369225 could not be found. {{(pid=124200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:34:24.805665 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-7083d028-20c5-4c53-bfca-f7ebc4ecc10d tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/82d887bd-9346-4f05-a5f1-91c783369225" status: 404 len: 109 microversion: 2.1 time: 0.049527 May 23 12:34:24.805665 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 80/154] 10.222.0.16 () {58 vars in 1247 bytes} [Mon May 23 12:34:24 2022] DELETE /compute/v2.1/os-volumes/82d887bd-9346-4f05-a5f1-91c783369225 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:34:24.809474 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0ab547bd-004a-48f2-83c5-51fd2cdf2335 tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] Calling method '.version_select at 0x7f095d538280>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:24.839383 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.wsgi [None req-0ab547bd-004a-48f2-83c5-51fd2cdf2335 tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] HTTP exception thrown: Volume 82d887bd-9346-4f05-a5f1-91c783369225 could not be found. May 23 12:34:24.841477 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0ab547bd-004a-48f2-83c5-51fd2cdf2335 tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] Request method failure captured: May 23 12:34:24.841477 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: request: GET /compute/v2.1/os-volumes/82d887bd-9346-4f05-a5f1-91c783369225 HTTP/1.1 May 23 12:34:24.841477 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept: application/json May 23 12:34:24.841477 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept-Encoding: identity May 23 12:34:24.841477 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Connection: close May 23 12:34:24.841477 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Length: 0 May 23 12:34:24.841477 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Type: application/json May 23 12:34:24.841477 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Host: 10.222.0.16 May 23 12:34:24.841477 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Openstack-System-Scope: None May 23 12:34:24.841477 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: User-Agent: python-urllib3/1.26.9 May 23 12:34:24.841477 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Auth-Token: gAAAAABii39HReuV-9ekERyUm0FLzXtYSFhxINOEwoF5JDXvLiYe-TH5eUPb3zYovNv_9dKieRnWPlosNK8m4w5XR94gGKfMnxtwojSg9si6ltdOYtO5gz0ReRy_W0zBWyao_XiIR2wtOxSKxAIGqqDJGkOM8mhIR1ou5JW48Ggi-pVa1NlG5H8 May 23 12:34:24.841477 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Id: None May 23 12:34:24.841477 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Name: None May 23 12:34:24.841477 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Identity-Status: Confirmed May 23 12:34:24.841477 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Is-Admin-Project: True May 23 12:34:24.841477 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Id: default May 23 12:34:24.841477 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Name: Default May 23 12:34:24.841477 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Id: 0b37b025b98d44eeb774bff2638fc48f May 23 12:34:24.841477 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1618264140 May 23 12:34:24.841477 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Role: member,reader May 23 12:34:24.841477 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Roles: member,reader May 23 12:34:24.842929 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0b37b025b98d44eeb774bff2638fc48f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0b37b025b98d44eeb774bff2638fc48f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0b37b025b98d44eeb774bff2638fc48f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0b37b025b98d44eeb774bff2638fc48f"}]}] May 23 12:34:24.842929 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1618264140 May 23 12:34:24.842929 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Id: 0b37b025b98d44eeb774bff2638fc48f May 23 12:34:24.842929 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1618264140 May 23 12:34:24.842929 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User: tempest-VolumesSnapshotsTestJSON-1618264140-project May 23 12:34:24.842929 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Id: default May 23 12:34:24.842929 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Name: Default May 23 12:34:24.842929 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Id: d58a8eb34c3c46f18d88d1be6e720e23 May 23 12:34:24.842929 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1618264140-project May 23 12:34:24.842929 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: method: May 23 12:34:24.842929 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: exception: Volume 82d887bd-9346-4f05-a5f1-91c783369225 could not be found. May 23 12:34:24.842929 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: action_args: {'id': '82d887bd-9346-4f05-a5f1-91c783369225'} May 23 12:34:24.842929 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:34:24.843861 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:34:24.843861 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 12:34:24.843861 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 12:34:24.843861 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 12:34:24.843861 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 12:34:24.843861 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 12:34:24.843861 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 12:34:24.843861 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 12:34:24.843861 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 12:34:24.843861 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 12:34:24.843861 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 12:34:24.843861 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 12:34:24.843861 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 12:34:24.843861 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 12:34:24.843861 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 12:34:24.843861 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 82d887bd-9346-4f05-a5f1-91c783369225 could not be found. (HTTP 404) (Request-ID: req-201d9a9a-5674-4f91-adbc-dafb8ea3c988) May 23 12:34:24.843861 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:34:24.843861 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:34:24.843861 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:34:24.845054 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:34:24.845054 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 23 12:34:24.845054 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 23 12:34:24.845054 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 12:34:24.845054 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 12:34:24.845054 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 12:34:24.845054 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 12:34:24.845054 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 12:34:24.845054 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 12:34:24.845054 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 12:34:24.845054 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 12:34:24.845054 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 12:34:24.845054 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 12:34:24.845054 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 12:34:24.845054 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 12:34:24.845054 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 12:34:24.845054 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 12:34:24.845054 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 12:34:24.845054 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 12:34:24.846724 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 12:34:24.846724 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 12:34:24.846724 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 12:34:24.846724 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 12:34:24.846724 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 82d887bd-9346-4f05-a5f1-91c783369225 could not be found. May 23 12:34:24.846724 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:34:24.846724 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:34:24.846724 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:34:24.846724 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:34:24.846724 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:34:24.846724 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:34:24.846724 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:34:24.846724 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:34:24.846724 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 12:34:24.846724 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 12:34:24.846724 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:34:24.846724 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:34:24.846724 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 23 12:34:24.846724 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:34:24.847722 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 82d887bd-9346-4f05-a5f1-91c783369225 could not be found. May 23 12:34:24.847722 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:34:24.847722 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:34:24.847722 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:34:24.847722 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:34:24.847722 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:34:24.847722 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:34:24.847722 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:34:24.847722 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:34:24.847722 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 82d887bd-9346-4f05-a5f1-91c783369225 could not be found. May 23 12:34:24.847722 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:34:24.847722 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0ab547bd-004a-48f2-83c5-51fd2cdf2335 tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] Returning 404 to user: Volume 82d887bd-9346-4f05-a5f1-91c783369225 could not be found. {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:34:24.847722 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-0ab547bd-004a-48f2-83c5-51fd2cdf2335 tempest-VolumesSnapshotsTestJSON-1618264140 tempest-VolumesSnapshotsTestJSON-1618264140-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/82d887bd-9346-4f05-a5f1-91c783369225" status: 404 len: 109 microversion: 2.1 time: 0.038380 May 23 12:34:24.847722 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 75/155] 10.222.0.16 () {58 vars in 1244 bytes} [Mon May 23 12:34:24 2022] GET /compute/v2.1/os-volumes/82d887bd-9346-4f05-a5f1-91c783369225 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 12:34:25.435755 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-95855eda-c4e1-4d03-a3dc-047cee54a9ce tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:25.437035 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-95855eda-c4e1-4d03-a3dc-047cee54a9ce tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:25.446672 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-95855eda-c4e1-4d03-a3dc-047cee54a9ce tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:25.447344 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-95855eda-c4e1-4d03-a3dc-047cee54a9ce tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:25.448750 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-95855eda-c4e1-4d03-a3dc-047cee54a9ce tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:25.449451 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-95855eda-c4e1-4d03-a3dc-047cee54a9ce tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:25.957405 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-95855eda-c4e1-4d03-a3dc-047cee54a9ce tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:25.976874 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-95855eda-c4e1-4d03-a3dc-047cee54a9ce tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1521 microversion: 2.1 time: 0.545419 May 23 12:34:25.977895 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 81/156] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:25 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1521 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:26.996006 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-25929d9f-2d8d-4a55-bc60-84ac80373050 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:27.000873 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-25929d9f-2d8d-4a55-bc60-84ac80373050 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:27.002921 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:27.024611 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-25929d9f-2d8d-4a55-bc60-84ac80373050 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:27.025258 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-25929d9f-2d8d-4a55-bc60-84ac80373050 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:27.026343 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-25929d9f-2d8d-4a55-bc60-84ac80373050 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:27.026791 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-25929d9f-2d8d-4a55-bc60-84ac80373050 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:27.296863 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-25929d9f-2d8d-4a55-bc60-84ac80373050 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:27.306541 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-25929d9f-2d8d-4a55-bc60-84ac80373050 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1521 microversion: 2.1 time: 0.314947 May 23 12:34:27.307239 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 76/157] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:26 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1521 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:27.333243 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-3775ae23-b327-447f-bb57-657f70f8a46d tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-56955661", "imageRef": "bb11dfa4-2977-4163-8237-78c871c8437f", "flavorRef": "452"}} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:34:27.392518 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.network.neutron [None req-3775ae23-b327-447f-bb57-657f70f8a46d tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] validate_networks() for None {{(pid=124200) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 12:34:27.726016 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-3775ae23-b327-447f-bb57-657f70f8a46d tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Flavor limits 0:0:0 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 12:34:27.727144 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-3775ae23-b327-447f-bb57-657f70f8a46d tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Image limits 0:0:0 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 12:34:27.728293 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-3775ae23-b327-447f-bb57-657f70f8a46d tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Flavor pref 0:0:0 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 12:34:27.729684 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-3775ae23-b327-447f-bb57-657f70f8a46d tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Image pref 0:0:0 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 12:34:27.730104 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-3775ae23-b327-447f-bb57-657f70f8a46d tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 12:34:27.744330 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3775ae23-b327-447f-bb57-657f70f8a46d tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:27.745096 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3775ae23-b327-447f-bb57-657f70f8a46d tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:27.746587 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3775ae23-b327-447f-bb57-657f70f8a46d tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:27.747047 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3775ae23-b327-447f-bb57-657f70f8a46d tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:27.770125 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.quota [None req-3775ae23-b327-447f-bb57-657f70f8a46d tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Getting quotas for project 61516a3c24f543d68bdb3724a11f7042. Resources: {'instances', 'cores', 'ram'} {{(pid=124200) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:34:27.775876 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.quota [None req-3775ae23-b327-447f-bb57-657f70f8a46d tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Getting quotas for user c819599f00844589b2957d9587c62d11 and project 61516a3c24f543d68bdb3724a11f7042. Resources: {'instances', 'cores', 'ram'} {{(pid=124200) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:34:27.799715 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-3775ae23-b327-447f-bb57-657f70f8a46d tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Going to run 1 instances... {{(pid=124200) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 12:34:27.802091 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-3775ae23-b327-447f-bb57-657f70f8a46d tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] [instance: 573d21c5-1aa6-45e2-88f6-2f8264d697ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb11dfa4-2977-4163-8237-78c871c8437f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124200) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 12:34:27.863188 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-3775ae23-b327-447f-bb57-657f70f8a46d tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.533754 May 23 12:34:27.863976 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 82/158] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 23 12:34:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 23 12:34:27.878247 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-94fa5fae-e502-4223-8e83-348da73c4b63 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:27.878858 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-94fa5fae-e502-4223-8e83-348da73c4b63 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] [instance: 573d21c5-1aa6-45e2-88f6-2f8264d697ad] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:27.955377 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-94fa5fae-e502-4223-8e83-348da73c4b63 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c819599f00844589b2957d9587c62d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61516a3c24f543d68bdb3724a11f7042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:27.965564 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-94fa5fae-e502-4223-8e83-348da73c4b63 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] 10.222.0.16 "GET /compute/v2.1/servers/573d21c5-1aa6-45e2-88f6-2f8264d697ad" status: 200 len: 1213 microversion: 2.1 time: 0.091069 May 23 12:34:27.975640 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 77/159] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:27 2022] GET /compute/v2.1/servers/573d21c5-1aa6-45e2-88f6-2f8264d697ad => generated 1213 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:28.326622 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-dd796def-2992-430b-8041-2aaa22ae3633 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:28.327326 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-dd796def-2992-430b-8041-2aaa22ae3633 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:28.335961 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-dd796def-2992-430b-8041-2aaa22ae3633 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:28.336972 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-dd796def-2992-430b-8041-2aaa22ae3633 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:28.338517 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-dd796def-2992-430b-8041-2aaa22ae3633 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:28.338967 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-dd796def-2992-430b-8041-2aaa22ae3633 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:28.523932 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-dd796def-2992-430b-8041-2aaa22ae3633 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:28.539804 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-dd796def-2992-430b-8041-2aaa22ae3633 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1521 microversion: 2.1 time: 0.218739 May 23 12:34:28.540854 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 83/160] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:28 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:28.983964 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0476e4ee-0300-40c6-8547-8463708c0d95 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:28.985359 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-0476e4ee-0300-40c6-8547-8463708c0d95 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] [instance: 573d21c5-1aa6-45e2-88f6-2f8264d697ad] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:28.992899 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0476e4ee-0300-40c6-8547-8463708c0d95 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:28.994499 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0476e4ee-0300-40c6-8547-8463708c0d95 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:28.996060 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0476e4ee-0300-40c6-8547-8463708c0d95 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:28.996841 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0476e4ee-0300-40c6-8547-8463708c0d95 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:29.081732 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0476e4ee-0300-40c6-8547-8463708c0d95 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c819599f00844589b2957d9587c62d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61516a3c24f543d68bdb3724a11f7042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:29.104245 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-0476e4ee-0300-40c6-8547-8463708c0d95 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] 10.222.0.16 "GET /compute/v2.1/servers/573d21c5-1aa6-45e2-88f6-2f8264d697ad" status: 200 len: 1265 microversion: 2.1 time: 0.125017 May 23 12:34:29.105062 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 78/161] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:28 2022] GET /compute/v2.1/servers/573d21c5-1aa6-45e2-88f6-2f8264d697ad => generated 1265 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:29.560507 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-cbac5c13-3998-4589-8900-87bd907c3736 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:29.562272 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-cbac5c13-3998-4589-8900-87bd907c3736 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:29.570403 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-cbac5c13-3998-4589-8900-87bd907c3736 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:29.571392 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-cbac5c13-3998-4589-8900-87bd907c3736 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:29.572623 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-cbac5c13-3998-4589-8900-87bd907c3736 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:29.573293 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-cbac5c13-3998-4589-8900-87bd907c3736 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:29.858228 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-cbac5c13-3998-4589-8900-87bd907c3736 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:29.866975 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-cbac5c13-3998-4589-8900-87bd907c3736 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1521 microversion: 2.1 time: 0.311172 May 23 12:34:29.867956 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 84/162] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:29 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:30.123242 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-43a65c01-ff31-4488-99b7-e8807a2e3157 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:30.123855 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-43a65c01-ff31-4488-99b7-e8807a2e3157 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] [instance: 573d21c5-1aa6-45e2-88f6-2f8264d697ad] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:30.129772 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-43a65c01-ff31-4488-99b7-e8807a2e3157 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:30.130227 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-43a65c01-ff31-4488-99b7-e8807a2e3157 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:30.131016 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-43a65c01-ff31-4488-99b7-e8807a2e3157 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:30.131443 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-43a65c01-ff31-4488-99b7-e8807a2e3157 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:30.379074 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-43a65c01-ff31-4488-99b7-e8807a2e3157 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c819599f00844589b2957d9587c62d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61516a3c24f543d68bdb3724a11f7042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:30.388635 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-43a65c01-ff31-4488-99b7-e8807a2e3157 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] 10.222.0.16 "GET /compute/v2.1/servers/573d21c5-1aa6-45e2-88f6-2f8264d697ad" status: 200 len: 1313 microversion: 2.1 time: 0.269095 May 23 12:34:30.389580 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 79/163] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:30 2022] GET /compute/v2.1/servers/573d21c5-1aa6-45e2-88f6-2f8264d697ad => generated 1313 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:30.895904 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-bec2462b-17c6-47dc-895d-9a4160c7456f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:30.901625 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-bec2462b-17c6-47dc-895d-9a4160c7456f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:30.916660 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-bec2462b-17c6-47dc-895d-9a4160c7456f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:30.918892 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-bec2462b-17c6-47dc-895d-9a4160c7456f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:30.921079 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-bec2462b-17c6-47dc-895d-9a4160c7456f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:30.922858 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-bec2462b-17c6-47dc-895d-9a4160c7456f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:31.190403 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-bec2462b-17c6-47dc-895d-9a4160c7456f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:31.196219 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-bec2462b-17c6-47dc-895d-9a4160c7456f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1521 microversion: 2.1 time: 0.310766 May 23 12:34:31.196819 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 85/164] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:30 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:31.339462 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-06b9fe2f-4e6a-45ba-8473-aa30e6821ddc req-f7717a39-f9ea-4926-afe8-3a35f53a24eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "573d21c5-1aa6-45e2-88f6-2f8264d697ad", "tag": "207628b7-9880-4125-89c2-e60ce250471c"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:34:31.356857 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-06b9fe2f-4e6a-45ba-8473-aa30e6821ddc req-f7717a39-f9ea-4926-afe8-3a35f53a24eb service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:31.357351 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-06b9fe2f-4e6a-45ba-8473-aa30e6821ddc req-f7717a39-f9ea-4926-afe8-3a35f53a24eb service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:31.372592 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-06b9fe2f-4e6a-45ba-8473-aa30e6821ddc req-f7717a39-f9ea-4926-afe8-3a35f53a24eb service nova] Creating event network-changed:207628b7-9880-4125-89c2-e60ce250471c for instance 573d21c5-1aa6-45e2-88f6-2f8264d697ad on hv-cinder-83699 May 23 12:34:31.386153 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-06b9fe2f-4e6a-45ba-8473-aa30e6821ddc req-f7717a39-f9ea-4926-afe8-3a35f53a24eb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050546 May 23 12:34:31.388583 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 80/165] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:34:31.406969 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-333c5855-b394-493d-93ab-7d8a10e7e0cb tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:31.407588 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-333c5855-b394-493d-93ab-7d8a10e7e0cb tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] [instance: 573d21c5-1aa6-45e2-88f6-2f8264d697ad] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:31.418134 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-333c5855-b394-493d-93ab-7d8a10e7e0cb tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:31.418601 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-333c5855-b394-493d-93ab-7d8a10e7e0cb tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:31.419407 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-333c5855-b394-493d-93ab-7d8a10e7e0cb tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:31.419851 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-333c5855-b394-493d-93ab-7d8a10e7e0cb tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:31.642433 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-333c5855-b394-493d-93ab-7d8a10e7e0cb tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c819599f00844589b2957d9587c62d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61516a3c24f543d68bdb3724a11f7042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:31.651625 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-333c5855-b394-493d-93ab-7d8a10e7e0cb tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] 10.222.0.16 "GET /compute/v2.1/servers/573d21c5-1aa6-45e2-88f6-2f8264d697ad" status: 200 len: 1313 microversion: 2.1 time: 0.248366 May 23 12:34:31.652250 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 86/166] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:31 2022] GET /compute/v2.1/servers/573d21c5-1aa6-45e2-88f6-2f8264d697ad => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:32.217261 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-6c01a83a-74ac-4699-ad8c-1616427a90b2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:32.218042 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-6c01a83a-74ac-4699-ad8c-1616427a90b2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:32.224973 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6c01a83a-74ac-4699-ad8c-1616427a90b2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:32.225722 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6c01a83a-74ac-4699-ad8c-1616427a90b2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:32.227559 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6c01a83a-74ac-4699-ad8c-1616427a90b2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:32.228197 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6c01a83a-74ac-4699-ad8c-1616427a90b2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:32.394796 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-6c01a83a-74ac-4699-ad8c-1616427a90b2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:32.406639 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-6c01a83a-74ac-4699-ad8c-1616427a90b2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1521 microversion: 2.1 time: 0.196497 May 23 12:34:32.407229 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 81/167] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:32 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:32.669407 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-9b636b3c-182c-4504-9e53-32fcd33c8a00 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:32.670016 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-9b636b3c-182c-4504-9e53-32fcd33c8a00 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] [instance: 573d21c5-1aa6-45e2-88f6-2f8264d697ad] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:32.676345 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9b636b3c-182c-4504-9e53-32fcd33c8a00 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:32.676796 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9b636b3c-182c-4504-9e53-32fcd33c8a00 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:32.679186 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9b636b3c-182c-4504-9e53-32fcd33c8a00 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:32.679186 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9b636b3c-182c-4504-9e53-32fcd33c8a00 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:32.828136 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-9b636b3c-182c-4504-9e53-32fcd33c8a00 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c819599f00844589b2957d9587c62d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61516a3c24f543d68bdb3724a11f7042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:32.836922 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-9b636b3c-182c-4504-9e53-32fcd33c8a00 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] 10.222.0.16 "GET /compute/v2.1/servers/573d21c5-1aa6-45e2-88f6-2f8264d697ad" status: 200 len: 1313 microversion: 2.1 time: 0.171443 May 23 12:34:32.837762 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 87/168] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:32 2022] GET /compute/v2.1/servers/573d21c5-1aa6-45e2-88f6-2f8264d697ad => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:34:33.423500 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-54c565ad-15d7-4087-8334-ced473d5e3c7 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:33.424113 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-54c565ad-15d7-4087-8334-ced473d5e3c7 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:33.430410 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-54c565ad-15d7-4087-8334-ced473d5e3c7 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:33.430861 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-54c565ad-15d7-4087-8334-ced473d5e3c7 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:33.431646 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-54c565ad-15d7-4087-8334-ced473d5e3c7 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:33.432084 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-54c565ad-15d7-4087-8334-ced473d5e3c7 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:33.565153 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-54c565ad-15d7-4087-8334-ced473d5e3c7 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:33.572366 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-54c565ad-15d7-4087-8334-ced473d5e3c7 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1521 microversion: 2.1 time: 0.152665 May 23 12:34:33.572938 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 82/169] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:33 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:33.856023 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-e0fa7748-8f78-4ce9-85d1-ed93509cdb7c tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:33.857074 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-e0fa7748-8f78-4ce9-85d1-ed93509cdb7c tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] [instance: 573d21c5-1aa6-45e2-88f6-2f8264d697ad] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:33.865983 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e0fa7748-8f78-4ce9-85d1-ed93509cdb7c tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:33.866430 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e0fa7748-8f78-4ce9-85d1-ed93509cdb7c tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:33.867209 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e0fa7748-8f78-4ce9-85d1-ed93509cdb7c tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:33.867692 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e0fa7748-8f78-4ce9-85d1-ed93509cdb7c tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:34.008104 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-e0fa7748-8f78-4ce9-85d1-ed93509cdb7c tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c819599f00844589b2957d9587c62d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61516a3c24f543d68bdb3724a11f7042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:34.015767 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-e0fa7748-8f78-4ce9-85d1-ed93509cdb7c tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] 10.222.0.16 "GET /compute/v2.1/servers/573d21c5-1aa6-45e2-88f6-2f8264d697ad" status: 200 len: 1313 microversion: 2.1 time: 0.165261 May 23 12:34:34.016378 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 88/170] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:33 2022] GET /compute/v2.1/servers/573d21c5-1aa6-45e2-88f6-2f8264d697ad => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:34.589454 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-1e3825e0-5ed9-4e5a-9026-e4c63c9022db tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:34.590047 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-1e3825e0-5ed9-4e5a-9026-e4c63c9022db tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:34.596456 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1e3825e0-5ed9-4e5a-9026-e4c63c9022db tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:34.596907 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1e3825e0-5ed9-4e5a-9026-e4c63c9022db tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:34.597687 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1e3825e0-5ed9-4e5a-9026-e4c63c9022db tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:34.598124 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1e3825e0-5ed9-4e5a-9026-e4c63c9022db tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:34.739725 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1e3825e0-5ed9-4e5a-9026-e4c63c9022db tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:34.749001 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-1e3825e0-5ed9-4e5a-9026-e4c63c9022db tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1521 microversion: 2.1 time: 0.163664 May 23 12:34:34.749595 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 83/171] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:34 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:35.033783 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-1b0d0f98-04bf-4a8e-ad8b-4ae7b894ce24 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:35.034569 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-1b0d0f98-04bf-4a8e-ad8b-4ae7b894ce24 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] [instance: 573d21c5-1aa6-45e2-88f6-2f8264d697ad] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:35.042406 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1b0d0f98-04bf-4a8e-ad8b-4ae7b894ce24 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:35.043224 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1b0d0f98-04bf-4a8e-ad8b-4ae7b894ce24 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:35.044006 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1b0d0f98-04bf-4a8e-ad8b-4ae7b894ce24 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:35.044469 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1b0d0f98-04bf-4a8e-ad8b-4ae7b894ce24 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:35.198032 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-1b0d0f98-04bf-4a8e-ad8b-4ae7b894ce24 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c819599f00844589b2957d9587c62d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61516a3c24f543d68bdb3724a11f7042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:35.210000 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-1b0d0f98-04bf-4a8e-ad8b-4ae7b894ce24 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] 10.222.0.16 "GET /compute/v2.1/servers/573d21c5-1aa6-45e2-88f6-2f8264d697ad" status: 200 len: 1313 microversion: 2.1 time: 0.179949 May 23 12:34:35.212296 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 89/172] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:35 2022] GET /compute/v2.1/servers/573d21c5-1aa6-45e2-88f6-2f8264d697ad => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:35.767052 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-29b65baa-cc14-4b8a-b74a-27c50d485463 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:35.767704 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-29b65baa-cc14-4b8a-b74a-27c50d485463 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:35.774469 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-29b65baa-cc14-4b8a-b74a-27c50d485463 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:35.774919 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-29b65baa-cc14-4b8a-b74a-27c50d485463 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:35.775708 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-29b65baa-cc14-4b8a-b74a-27c50d485463 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:35.776138 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-29b65baa-cc14-4b8a-b74a-27c50d485463 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:35.936122 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-29b65baa-cc14-4b8a-b74a-27c50d485463 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:35.943816 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-29b65baa-cc14-4b8a-b74a-27c50d485463 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1521 microversion: 2.1 time: 0.180645 May 23 12:34:35.944427 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 84/173] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:35 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:36.230904 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-6e3ddc4d-8b6a-44f2-818d-cd969ee1cf8c tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:36.231572 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-6e3ddc4d-8b6a-44f2-818d-cd969ee1cf8c tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] [instance: 573d21c5-1aa6-45e2-88f6-2f8264d697ad] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:36.238342 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6e3ddc4d-8b6a-44f2-818d-cd969ee1cf8c tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:36.241185 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6e3ddc4d-8b6a-44f2-818d-cd969ee1cf8c tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:36.241185 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6e3ddc4d-8b6a-44f2-818d-cd969ee1cf8c tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:36.241185 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6e3ddc4d-8b6a-44f2-818d-cd969ee1cf8c tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:36.370710 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-6e3ddc4d-8b6a-44f2-818d-cd969ee1cf8c tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c819599f00844589b2957d9587c62d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61516a3c24f543d68bdb3724a11f7042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:36.378462 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-6e3ddc4d-8b6a-44f2-818d-cd969ee1cf8c tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] 10.222.0.16 "GET /compute/v2.1/servers/573d21c5-1aa6-45e2-88f6-2f8264d697ad" status: 200 len: 1313 microversion: 2.1 time: 0.151972 May 23 12:34:36.379039 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 90/174] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:36 2022] GET /compute/v2.1/servers/573d21c5-1aa6-45e2-88f6-2f8264d697ad => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:36.963911 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-1e6e4d7a-b315-4f5d-a342-23cee6b77b91 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:36.963911 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-1e6e4d7a-b315-4f5d-a342-23cee6b77b91 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:36.975729 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1e6e4d7a-b315-4f5d-a342-23cee6b77b91 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:36.976923 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1e6e4d7a-b315-4f5d-a342-23cee6b77b91 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:36.977715 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1e6e4d7a-b315-4f5d-a342-23cee6b77b91 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:36.978143 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1e6e4d7a-b315-4f5d-a342-23cee6b77b91 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:37.114501 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1e6e4d7a-b315-4f5d-a342-23cee6b77b91 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:37.122355 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-1e6e4d7a-b315-4f5d-a342-23cee6b77b91 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1521 microversion: 2.1 time: 0.165384 May 23 12:34:37.122911 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 85/175] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:36 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:37.400434 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-52906d88-6cf8-4e97-98b5-965d0ff8cac7 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:37.400434 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-52906d88-6cf8-4e97-98b5-965d0ff8cac7 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] [instance: 573d21c5-1aa6-45e2-88f6-2f8264d697ad] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:37.406771 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-52906d88-6cf8-4e97-98b5-965d0ff8cac7 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:37.407214 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-52906d88-6cf8-4e97-98b5-965d0ff8cac7 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:37.407986 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-52906d88-6cf8-4e97-98b5-965d0ff8cac7 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:37.408442 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-52906d88-6cf8-4e97-98b5-965d0ff8cac7 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:37.541070 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-52906d88-6cf8-4e97-98b5-965d0ff8cac7 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c819599f00844589b2957d9587c62d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61516a3c24f543d68bdb3724a11f7042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:37.548673 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-52906d88-6cf8-4e97-98b5-965d0ff8cac7 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] 10.222.0.16 "GET /compute/v2.1/servers/573d21c5-1aa6-45e2-88f6-2f8264d697ad" status: 200 len: 1313 microversion: 2.1 time: 0.153945 May 23 12:34:37.549276 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 91/176] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:37 2022] GET /compute/v2.1/servers/573d21c5-1aa6-45e2-88f6-2f8264d697ad => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:38.139136 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-e75c3a0c-141e-43c3-960a-50b584cf011f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:38.139725 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-e75c3a0c-141e-43c3-960a-50b584cf011f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:38.141804 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell0:SELECT=2 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:38.147350 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e75c3a0c-141e-43c3-960a-50b584cf011f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:38.147791 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e75c3a0c-141e-43c3-960a-50b584cf011f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:38.148628 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e75c3a0c-141e-43c3-960a-50b584cf011f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:38.149059 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e75c3a0c-141e-43c3-960a-50b584cf011f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:38.164934 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:38.495718 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-e75c3a0c-141e-43c3-960a-50b584cf011f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:38.503296 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-e75c3a0c-141e-43c3-960a-50b584cf011f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1521 microversion: 2.1 time: 0.368632 May 23 12:34:38.503877 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 86/177] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:38 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1521 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:38.565955 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-381f5c9d-7bd3-476f-96af-ab983ad23d1e tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:38.566564 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-381f5c9d-7bd3-476f-96af-ab983ad23d1e tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] [instance: 573d21c5-1aa6-45e2-88f6-2f8264d697ad] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:38.568456 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell0:SELECT=2 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:38.569107 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell0:SELECT=6 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:38.575808 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-381f5c9d-7bd3-476f-96af-ab983ad23d1e tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:38.576281 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-381f5c9d-7bd3-476f-96af-ab983ad23d1e tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:38.577062 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-381f5c9d-7bd3-476f-96af-ab983ad23d1e tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:38.577498 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-381f5c9d-7bd3-476f-96af-ab983ad23d1e tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:38.718362 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-381f5c9d-7bd3-476f-96af-ab983ad23d1e tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c819599f00844589b2957d9587c62d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61516a3c24f543d68bdb3724a11f7042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:38.726964 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-381f5c9d-7bd3-476f-96af-ab983ad23d1e tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] 10.222.0.16 "GET /compute/v2.1/servers/573d21c5-1aa6-45e2-88f6-2f8264d697ad" status: 200 len: 1313 microversion: 2.1 time: 0.164635 May 23 12:34:38.727752 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 92/178] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:38 2022] GET /compute/v2.1/servers/573d21c5-1aa6-45e2-88f6-2f8264d697ad => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:39.520566 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-cdbfe599-a747-4e08-a6f0-2e3b193fcee2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:39.521804 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-cdbfe599-a747-4e08-a6f0-2e3b193fcee2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:39.528162 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cdbfe599-a747-4e08-a6f0-2e3b193fcee2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:39.528650 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cdbfe599-a747-4e08-a6f0-2e3b193fcee2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:39.529431 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cdbfe599-a747-4e08-a6f0-2e3b193fcee2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:39.529866 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cdbfe599-a747-4e08-a6f0-2e3b193fcee2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:39.688310 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-cdbfe599-a747-4e08-a6f0-2e3b193fcee2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:39.700008 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-cdbfe599-a747-4e08-a6f0-2e3b193fcee2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1521 microversion: 2.1 time: 0.179414 May 23 12:34:39.700893 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 87/179] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:39 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:39.744885 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-ef017eb7-c605-489e-bb0f-1820466db2e5 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:39.745497 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-ef017eb7-c605-489e-bb0f-1820466db2e5 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] [instance: 573d21c5-1aa6-45e2-88f6-2f8264d697ad] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:39.747872 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:39.753758 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ef017eb7-c605-489e-bb0f-1820466db2e5 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:39.754206 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ef017eb7-c605-489e-bb0f-1820466db2e5 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:39.754988 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ef017eb7-c605-489e-bb0f-1820466db2e5 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:39.755420 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ef017eb7-c605-489e-bb0f-1820466db2e5 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:39.893079 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-ef017eb7-c605-489e-bb0f-1820466db2e5 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c819599f00844589b2957d9587c62d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61516a3c24f543d68bdb3724a11f7042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:39.900848 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-ef017eb7-c605-489e-bb0f-1820466db2e5 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] 10.222.0.16 "GET /compute/v2.1/servers/573d21c5-1aa6-45e2-88f6-2f8264d697ad" status: 200 len: 1313 microversion: 2.1 time: 0.160450 May 23 12:34:39.901432 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 93/180] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:39 2022] GET /compute/v2.1/servers/573d21c5-1aa6-45e2-88f6-2f8264d697ad => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:40.717765 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-2479fb6e-6e46-4029-a58a-07314026cea8 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:40.718385 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-2479fb6e-6e46-4029-a58a-07314026cea8 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:40.724953 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2479fb6e-6e46-4029-a58a-07314026cea8 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:40.725330 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2479fb6e-6e46-4029-a58a-07314026cea8 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:40.726127 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2479fb6e-6e46-4029-a58a-07314026cea8 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:40.727352 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2479fb6e-6e46-4029-a58a-07314026cea8 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:40.861659 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-2479fb6e-6e46-4029-a58a-07314026cea8 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:40.871654 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-2479fb6e-6e46-4029-a58a-07314026cea8 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1521 microversion: 2.1 time: 0.157822 May 23 12:34:40.872252 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 88/181] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:40 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:40.917334 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-be764664-e47c-4ba8-999d-15abdd12eaf2 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:40.917934 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-be764664-e47c-4ba8-999d-15abdd12eaf2 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] [instance: 573d21c5-1aa6-45e2-88f6-2f8264d697ad] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:40.924443 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-be764664-e47c-4ba8-999d-15abdd12eaf2 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:40.924888 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-be764664-e47c-4ba8-999d-15abdd12eaf2 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:40.925650 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-be764664-e47c-4ba8-999d-15abdd12eaf2 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:40.926079 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-be764664-e47c-4ba8-999d-15abdd12eaf2 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:41.063597 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-be764664-e47c-4ba8-999d-15abdd12eaf2 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c819599f00844589b2957d9587c62d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61516a3c24f543d68bdb3724a11f7042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:41.073155 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-be764664-e47c-4ba8-999d-15abdd12eaf2 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] 10.222.0.16 "GET /compute/v2.1/servers/573d21c5-1aa6-45e2-88f6-2f8264d697ad" status: 200 len: 1313 microversion: 2.1 time: 0.160025 May 23 12:34:41.074172 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 94/182] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:40 2022] GET /compute/v2.1/servers/573d21c5-1aa6-45e2-88f6-2f8264d697ad => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:41.888424 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-9412505d-ba89-419c-8992-802f1192d6ff tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:41.889035 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-9412505d-ba89-419c-8992-802f1192d6ff tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:41.895188 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9412505d-ba89-419c-8992-802f1192d6ff tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:41.895630 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9412505d-ba89-419c-8992-802f1192d6ff tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:41.896434 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9412505d-ba89-419c-8992-802f1192d6ff tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:41.896868 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9412505d-ba89-419c-8992-802f1192d6ff tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:42.034634 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9412505d-ba89-419c-8992-802f1192d6ff tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:42.043265 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-9412505d-ba89-419c-8992-802f1192d6ff tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1521 microversion: 2.1 time: 0.158717 May 23 12:34:42.043844 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 89/183] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:41 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:42.093437 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-9e0e0278-11aa-4a52-a1d3-4f7186903334 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:42.094240 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-9e0e0278-11aa-4a52-a1d3-4f7186903334 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] [instance: 573d21c5-1aa6-45e2-88f6-2f8264d697ad] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:42.101499 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9e0e0278-11aa-4a52-a1d3-4f7186903334 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:42.101953 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9e0e0278-11aa-4a52-a1d3-4f7186903334 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:42.102829 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9e0e0278-11aa-4a52-a1d3-4f7186903334 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:42.103263 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9e0e0278-11aa-4a52-a1d3-4f7186903334 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:42.245123 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-9e0e0278-11aa-4a52-a1d3-4f7186903334 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c819599f00844589b2957d9587c62d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61516a3c24f543d68bdb3724a11f7042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:42.252910 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-9e0e0278-11aa-4a52-a1d3-4f7186903334 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] 10.222.0.16 "GET /compute/v2.1/servers/573d21c5-1aa6-45e2-88f6-2f8264d697ad" status: 200 len: 1313 microversion: 2.1 time: 0.163452 May 23 12:34:42.253476 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 95/184] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:42 2022] GET /compute/v2.1/servers/573d21c5-1aa6-45e2-88f6-2f8264d697ad => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:43.061247 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-37bcabc1-6dde-4efa-a7e4-0028d2b1aacd tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:43.061864 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-37bcabc1-6dde-4efa-a7e4-0028d2b1aacd tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:43.068050 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-37bcabc1-6dde-4efa-a7e4-0028d2b1aacd tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:43.068669 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-37bcabc1-6dde-4efa-a7e4-0028d2b1aacd tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:43.069511 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-37bcabc1-6dde-4efa-a7e4-0028d2b1aacd tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:43.070000 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-37bcabc1-6dde-4efa-a7e4-0028d2b1aacd tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:43.214347 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-37bcabc1-6dde-4efa-a7e4-0028d2b1aacd tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:43.222307 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-37bcabc1-6dde-4efa-a7e4-0028d2b1aacd tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1521 microversion: 2.1 time: 0.164867 May 23 12:34:43.222903 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 90/185] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:43 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:43.234820 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-066d6e7c-2b59-4765-b5fd-1efde57975b5 req-8c9f3bf4-da66-4e84-bbb8-a8e41678bbff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "573d21c5-1aa6-45e2-88f6-2f8264d697ad", "name": "network-vif-plugged", "status": "completed", "tag": "207628b7-9880-4125-89c2-e60ce250471c"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:34:43.244534 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-066d6e7c-2b59-4765-b5fd-1efde57975b5 req-8c9f3bf4-da66-4e84-bbb8-a8e41678bbff service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:43.245244 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-066d6e7c-2b59-4765-b5fd-1efde57975b5 req-8c9f3bf4-da66-4e84-bbb8-a8e41678bbff service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:43.257185 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-066d6e7c-2b59-4765-b5fd-1efde57975b5 req-8c9f3bf4-da66-4e84-bbb8-a8e41678bbff service nova] Creating event network-vif-plugged:207628b7-9880-4125-89c2-e60ce250471c for instance 573d21c5-1aa6-45e2-88f6-2f8264d697ad on hv-cinder-83699 May 23 12:34:43.262889 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-066d6e7c-2b59-4765-b5fd-1efde57975b5 req-8c9f3bf4-da66-4e84-bbb8-a8e41678bbff service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037849 May 23 12:34:43.264007 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 96/186] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:34:43.270134 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0cab3bbe-2dfc-4aa0-90ab-43600384335d tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:43.270753 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-0cab3bbe-2dfc-4aa0-90ab-43600384335d tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] [instance: 573d21c5-1aa6-45e2-88f6-2f8264d697ad] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:43.288922 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0cab3bbe-2dfc-4aa0-90ab-43600384335d tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:43.292022 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0cab3bbe-2dfc-4aa0-90ab-43600384335d tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:43.293624 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0cab3bbe-2dfc-4aa0-90ab-43600384335d tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:43.294086 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0cab3bbe-2dfc-4aa0-90ab-43600384335d tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:43.490934 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0cab3bbe-2dfc-4aa0-90ab-43600384335d tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c819599f00844589b2957d9587c62d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61516a3c24f543d68bdb3724a11f7042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:43.499318 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-0cab3bbe-2dfc-4aa0-90ab-43600384335d tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] 10.222.0.16 "GET /compute/v2.1/servers/573d21c5-1aa6-45e2-88f6-2f8264d697ad" status: 200 len: 1313 microversion: 2.1 time: 0.233126 May 23 12:34:43.500071 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 91/187] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:43 2022] GET /compute/v2.1/servers/573d21c5-1aa6-45e2-88f6-2f8264d697ad => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:44.239959 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-49463d08-cd8d-4ddf-a453-96dc04faa888 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:44.240679 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-49463d08-cd8d-4ddf-a453-96dc04faa888 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:44.247330 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-49463d08-cd8d-4ddf-a453-96dc04faa888 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:44.247772 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-49463d08-cd8d-4ddf-a453-96dc04faa888 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:44.248577 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-49463d08-cd8d-4ddf-a453-96dc04faa888 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:44.249010 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-49463d08-cd8d-4ddf-a453-96dc04faa888 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:44.385461 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-49463d08-cd8d-4ddf-a453-96dc04faa888 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:44.393325 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-49463d08-cd8d-4ddf-a453-96dc04faa888 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1521 microversion: 2.1 time: 0.158020 May 23 12:34:44.393905 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 97/188] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:44 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:44.518908 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-5b267ae1-db4a-406b-a0fb-5d1b1943082b tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:44.519439 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-5b267ae1-db4a-406b-a0fb-5d1b1943082b tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] [instance: 573d21c5-1aa6-45e2-88f6-2f8264d697ad] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:44.525797 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5b267ae1-db4a-406b-a0fb-5d1b1943082b tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:44.526246 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5b267ae1-db4a-406b-a0fb-5d1b1943082b tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:44.527037 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5b267ae1-db4a-406b-a0fb-5d1b1943082b tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:44.527474 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5b267ae1-db4a-406b-a0fb-5d1b1943082b tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:44.666075 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-5b267ae1-db4a-406b-a0fb-5d1b1943082b tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c819599f00844589b2957d9587c62d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61516a3c24f543d68bdb3724a11f7042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:44.673601 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-5b267ae1-db4a-406b-a0fb-5d1b1943082b tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] 10.222.0.16 "GET /compute/v2.1/servers/573d21c5-1aa6-45e2-88f6-2f8264d697ad" status: 200 len: 1313 microversion: 2.1 time: 0.159093 May 23 12:34:44.674178 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 92/189] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:44 2022] GET /compute/v2.1/servers/573d21c5-1aa6-45e2-88f6-2f8264d697ad => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:34:45.412591 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-5e81a693-c6e9-42f0-bb7f-5fba23104403 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:45.414835 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-5e81a693-c6e9-42f0-bb7f-5fba23104403 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:45.422196 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5e81a693-c6e9-42f0-bb7f-5fba23104403 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:45.422647 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5e81a693-c6e9-42f0-bb7f-5fba23104403 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:45.423452 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5e81a693-c6e9-42f0-bb7f-5fba23104403 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:45.423930 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5e81a693-c6e9-42f0-bb7f-5fba23104403 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:45.561010 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-5e81a693-c6e9-42f0-bb7f-5fba23104403 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:45.563340 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell1:SELECT=100 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:45.570995 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-5e81a693-c6e9-42f0-bb7f-5fba23104403 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1521 microversion: 2.1 time: 0.163698 May 23 12:34:45.571581 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 98/190] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:45 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:45.690566 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-eba9d464-5c0f-40a7-847a-dd46c5ea8a6d tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:45.691175 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-eba9d464-5c0f-40a7-847a-dd46c5ea8a6d tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] [instance: 573d21c5-1aa6-45e2-88f6-2f8264d697ad] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:45.699051 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-eba9d464-5c0f-40a7-847a-dd46c5ea8a6d tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:45.699723 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-eba9d464-5c0f-40a7-847a-dd46c5ea8a6d tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:45.700959 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-eba9d464-5c0f-40a7-847a-dd46c5ea8a6d tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:45.701597 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-eba9d464-5c0f-40a7-847a-dd46c5ea8a6d tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:45.834649 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-eba9d464-5c0f-40a7-847a-dd46c5ea8a6d tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c819599f00844589b2957d9587c62d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61516a3c24f543d68bdb3724a11f7042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:45.843894 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-eba9d464-5c0f-40a7-847a-dd46c5ea8a6d tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] 10.222.0.16 "GET /compute/v2.1/servers/573d21c5-1aa6-45e2-88f6-2f8264d697ad" status: 200 len: 1463 microversion: 2.1 time: 0.157267 May 23 12:34:45.844521 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 93/191] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:45 2022] GET /compute/v2.1/servers/573d21c5-1aa6-45e2-88f6-2f8264d697ad => generated 1463 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:45.888265 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-8a844542-92c4-4d1f-9191-75b6fca14ed2 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:45.889106 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-8a844542-92c4-4d1f-9191-75b6fca14ed2 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] [instance: 573d21c5-1aa6-45e2-88f6-2f8264d697ad] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:45.895360 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8a844542-92c4-4d1f-9191-75b6fca14ed2 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:45.895809 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8a844542-92c4-4d1f-9191-75b6fca14ed2 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:45.896627 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8a844542-92c4-4d1f-9191-75b6fca14ed2 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:45.897064 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8a844542-92c4-4d1f-9191-75b6fca14ed2 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:45.923662 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-8a844542-92c4-4d1f-9191-75b6fca14ed2 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] [instance: 573d21c5-1aa6-45e2-88f6-2f8264d697ad] Going to try to terminate instance {{(pid=124200) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 12:34:46.020998 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-8a844542-92c4-4d1f-9191-75b6fca14ed2 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] 10.222.0.16 "DELETE /compute/v2.1/servers/573d21c5-1aa6-45e2-88f6-2f8264d697ad" status: 204 len: 0 microversion: 2.1 time: 0.136408 May 23 12:34:46.029784 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 99/192] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 12:34:45 2022] DELETE /compute/v2.1/servers/573d21c5-1aa6-45e2-88f6-2f8264d697ad => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 23 12:34:46.037435 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-48bb4c8a-4c68-442e-a1be-9b4729ac2aa8 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:46.038033 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-48bb4c8a-4c68-442e-a1be-9b4729ac2aa8 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] [instance: 573d21c5-1aa6-45e2-88f6-2f8264d697ad] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:46.045363 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-48bb4c8a-4c68-442e-a1be-9b4729ac2aa8 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:46.045927 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-48bb4c8a-4c68-442e-a1be-9b4729ac2aa8 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:46.046563 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-48bb4c8a-4c68-442e-a1be-9b4729ac2aa8 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:46.047296 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-48bb4c8a-4c68-442e-a1be-9b4729ac2aa8 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:46.190369 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-48bb4c8a-4c68-442e-a1be-9b4729ac2aa8 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c819599f00844589b2957d9587c62d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61516a3c24f543d68bdb3724a11f7042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:46.199164 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-48bb4c8a-4c68-442e-a1be-9b4729ac2aa8 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] 10.222.0.16 "GET /compute/v2.1/servers/573d21c5-1aa6-45e2-88f6-2f8264d697ad" status: 200 len: 1469 microversion: 2.1 time: 0.165903 May 23 12:34:46.209235 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 94/193] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:46 2022] GET /compute/v2.1/servers/573d21c5-1aa6-45e2-88f6-2f8264d697ad => generated 1469 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:34:46.593943 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-e9a3c878-ea12-44a2-a9b3-ec80dac6a142 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:46.595164 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-e9a3c878-ea12-44a2-a9b3-ec80dac6a142 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:46.604838 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e9a3c878-ea12-44a2-a9b3-ec80dac6a142 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:46.605473 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e9a3c878-ea12-44a2-a9b3-ec80dac6a142 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:46.606442 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e9a3c878-ea12-44a2-a9b3-ec80dac6a142 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:46.607202 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e9a3c878-ea12-44a2-a9b3-ec80dac6a142 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:46.758829 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-e9a3c878-ea12-44a2-a9b3-ec80dac6a142 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:46.768245 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-e9a3c878-ea12-44a2-a9b3-ec80dac6a142 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1521 microversion: 2.1 time: 0.181514 May 23 12:34:46.769315 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 100/194] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:46 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:47.217303 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f75f1ffd-6459-4e08-88cb-80bdbf6e1892 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:47.217930 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-f75f1ffd-6459-4e08-88cb-80bdbf6e1892 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] [instance: 573d21c5-1aa6-45e2-88f6-2f8264d697ad] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:47.224188 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f75f1ffd-6459-4e08-88cb-80bdbf6e1892 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:47.224653 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f75f1ffd-6459-4e08-88cb-80bdbf6e1892 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:47.225433 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f75f1ffd-6459-4e08-88cb-80bdbf6e1892 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:47.226012 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f75f1ffd-6459-4e08-88cb-80bdbf6e1892 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:47.364991 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f75f1ffd-6459-4e08-88cb-80bdbf6e1892 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c819599f00844589b2957d9587c62d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61516a3c24f543d68bdb3724a11f7042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:47.373248 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f75f1ffd-6459-4e08-88cb-80bdbf6e1892 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] 10.222.0.16 "GET /compute/v2.1/servers/573d21c5-1aa6-45e2-88f6-2f8264d697ad" status: 200 len: 1469 microversion: 2.1 time: 0.159845 May 23 12:34:47.374172 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 95/195] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:47 2022] GET /compute/v2.1/servers/573d21c5-1aa6-45e2-88f6-2f8264d697ad => generated 1469 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:47.794619 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-ae6be51b-42fa-4007-9645-c7b2d728b219 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:47.795603 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-ae6be51b-42fa-4007-9645-c7b2d728b219 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:47.803159 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ae6be51b-42fa-4007-9645-c7b2d728b219 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:47.803613 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ae6be51b-42fa-4007-9645-c7b2d728b219 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:47.804954 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ae6be51b-42fa-4007-9645-c7b2d728b219 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:47.805620 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ae6be51b-42fa-4007-9645-c7b2d728b219 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:47.948789 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-ae6be51b-42fa-4007-9645-c7b2d728b219 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:47.957214 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-ae6be51b-42fa-4007-9645-c7b2d728b219 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1521 microversion: 2.1 time: 0.169192 May 23 12:34:47.957802 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 101/196] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:47 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:48.394099 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-deabe03d-1ce4-4619-9f1c-d2f11cef5d92 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:48.394619 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-deabe03d-1ce4-4619-9f1c-d2f11cef5d92 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] [instance: 573d21c5-1aa6-45e2-88f6-2f8264d697ad] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:48.401314 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-deabe03d-1ce4-4619-9f1c-d2f11cef5d92 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:48.401760 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-deabe03d-1ce4-4619-9f1c-d2f11cef5d92 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:48.402536 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-deabe03d-1ce4-4619-9f1c-d2f11cef5d92 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:48.403052 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-deabe03d-1ce4-4619-9f1c-d2f11cef5d92 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:48.559628 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-deabe03d-1ce4-4619-9f1c-d2f11cef5d92 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c819599f00844589b2957d9587c62d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61516a3c24f543d68bdb3724a11f7042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:48.567700 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-deabe03d-1ce4-4619-9f1c-d2f11cef5d92 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] 10.222.0.16 "GET /compute/v2.1/servers/573d21c5-1aa6-45e2-88f6-2f8264d697ad" status: 200 len: 1469 microversion: 2.1 time: 0.177822 May 23 12:34:48.568311 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 96/197] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:48 2022] GET /compute/v2.1/servers/573d21c5-1aa6-45e2-88f6-2f8264d697ad => generated 1469 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:48.974299 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-37feb424-aa72-4903-b47a-a8f50a0f5711 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:48.974914 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-37feb424-aa72-4903-b47a-a8f50a0f5711 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:48.982417 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-37feb424-aa72-4903-b47a-a8f50a0f5711 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:48.982875 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-37feb424-aa72-4903-b47a-a8f50a0f5711 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:48.983671 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-37feb424-aa72-4903-b47a-a8f50a0f5711 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:48.984228 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-37feb424-aa72-4903-b47a-a8f50a0f5711 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:49.123546 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-37feb424-aa72-4903-b47a-a8f50a0f5711 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:49.131280 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-37feb424-aa72-4903-b47a-a8f50a0f5711 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1521 microversion: 2.1 time: 0.160808 May 23 12:34:49.131852 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 102/198] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:48 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:49.587099 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-147792de-2d31-4c5b-b1f3-cbdeb21210dc tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:49.587713 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-147792de-2d31-4c5b-b1f3-cbdeb21210dc tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] [instance: 573d21c5-1aa6-45e2-88f6-2f8264d697ad] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:49.594084 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-147792de-2d31-4c5b-b1f3-cbdeb21210dc tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:49.594535 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-147792de-2d31-4c5b-b1f3-cbdeb21210dc tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:49.595459 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-147792de-2d31-4c5b-b1f3-cbdeb21210dc tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:49.595900 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-147792de-2d31-4c5b-b1f3-cbdeb21210dc tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:49.739413 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-147792de-2d31-4c5b-b1f3-cbdeb21210dc tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c819599f00844589b2957d9587c62d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61516a3c24f543d68bdb3724a11f7042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:49.748329 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-147792de-2d31-4c5b-b1f3-cbdeb21210dc tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] 10.222.0.16 "GET /compute/v2.1/servers/573d21c5-1aa6-45e2-88f6-2f8264d697ad" status: 200 len: 1469 microversion: 2.1 time: 0.166085 May 23 12:34:49.748937 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 97/199] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:49 2022] GET /compute/v2.1/servers/573d21c5-1aa6-45e2-88f6-2f8264d697ad => generated 1469 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:50.148344 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-73065925-c053-46f8-9161-a552847cd30e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:50.148959 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-73065925-c053-46f8-9161-a552847cd30e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:50.155676 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-73065925-c053-46f8-9161-a552847cd30e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:50.156159 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-73065925-c053-46f8-9161-a552847cd30e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:50.156973 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-73065925-c053-46f8-9161-a552847cd30e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:50.157410 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-73065925-c053-46f8-9161-a552847cd30e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:50.298130 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-73065925-c053-46f8-9161-a552847cd30e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:50.306520 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-73065925-c053-46f8-9161-a552847cd30e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1521 microversion: 2.1 time: 0.162060 May 23 12:34:50.307136 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 103/200] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:50 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:50.765985 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-3f74b2ba-a699-4da8-a52a-3795f435565e tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:50.767051 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-3f74b2ba-a699-4da8-a52a-3795f435565e tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] [instance: 573d21c5-1aa6-45e2-88f6-2f8264d697ad] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:50.775045 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3f74b2ba-a699-4da8-a52a-3795f435565e tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:50.775497 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3f74b2ba-a699-4da8-a52a-3795f435565e tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:50.776317 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3f74b2ba-a699-4da8-a52a-3795f435565e tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:50.776747 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3f74b2ba-a699-4da8-a52a-3795f435565e tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:51.036111 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-3f74b2ba-a699-4da8-a52a-3795f435565e tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c819599f00844589b2957d9587c62d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61516a3c24f543d68bdb3724a11f7042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:51.050291 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-3f74b2ba-a699-4da8-a52a-3795f435565e tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] 10.222.0.16 "GET /compute/v2.1/servers/573d21c5-1aa6-45e2-88f6-2f8264d697ad" status: 200 len: 1469 microversion: 2.1 time: 0.288120 May 23 12:34:51.060521 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 98/201] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:50 2022] GET /compute/v2.1/servers/573d21c5-1aa6-45e2-88f6-2f8264d697ad => generated 1469 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:51.080850 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-641d3349-47b9-4cec-af93-4e45020fcfb5 req-62b2db54-e2d2-4b7f-a5cb-ed49b79ef07e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "573d21c5-1aa6-45e2-88f6-2f8264d697ad", "name": "network-vif-deleted", "tag": "207628b7-9880-4125-89c2-e60ce250471c"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:34:51.094994 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-641d3349-47b9-4cec-af93-4e45020fcfb5 req-62b2db54-e2d2-4b7f-a5cb-ed49b79ef07e service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:51.095770 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-641d3349-47b9-4cec-af93-4e45020fcfb5 req-62b2db54-e2d2-4b7f-a5cb-ed49b79ef07e service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:51.114420 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-641d3349-47b9-4cec-af93-4e45020fcfb5 req-62b2db54-e2d2-4b7f-a5cb-ed49b79ef07e service nova] Creating event network-vif-deleted:207628b7-9880-4125-89c2-e60ce250471c for instance 573d21c5-1aa6-45e2-88f6-2f8264d697ad on hv-cinder-83699 May 23 12:34:51.121983 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-641d3349-47b9-4cec-af93-4e45020fcfb5 req-62b2db54-e2d2-4b7f-a5cb-ed49b79ef07e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045758 May 23 12:34:51.123277 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 104/202] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:34:51.326858 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-82a7ac7b-3ba0-459c-910c-c536fce5f9db tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:51.327468 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-82a7ac7b-3ba0-459c-910c-c536fce5f9db tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:51.339728 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-82a7ac7b-3ba0-459c-910c-c536fce5f9db tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:51.340253 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-82a7ac7b-3ba0-459c-910c-c536fce5f9db tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:51.341047 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-82a7ac7b-3ba0-459c-910c-c536fce5f9db tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:51.341520 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-82a7ac7b-3ba0-459c-910c-c536fce5f9db tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:51.511553 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-82a7ac7b-3ba0-459c-910c-c536fce5f9db tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:51.521586 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-82a7ac7b-3ba0-459c-910c-c536fce5f9db tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1521 microversion: 2.1 time: 0.201900 May 23 12:34:51.522158 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 99/203] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:51 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:52.068984 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-7534b9e5-a0a8-465f-a837-f27880092011 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:52.069714 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-7534b9e5-a0a8-465f-a837-f27880092011 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] [instance: 573d21c5-1aa6-45e2-88f6-2f8264d697ad] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:52.076313 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7534b9e5-a0a8-465f-a837-f27880092011 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:52.076766 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7534b9e5-a0a8-465f-a837-f27880092011 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:52.077534 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7534b9e5-a0a8-465f-a837-f27880092011 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:52.077965 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7534b9e5-a0a8-465f-a837-f27880092011 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:52.098531 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.wsgi [None req-7534b9e5-a0a8-465f-a837-f27880092011 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] HTTP exception thrown: Instance 573d21c5-1aa6-45e2-88f6-2f8264d697ad could not be found. May 23 12:34:52.100202 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-7534b9e5-a0a8-465f-a837-f27880092011 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Request method failure captured: May 23 12:34:52.100202 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: request: GET /compute/v2.1/servers/573d21c5-1aa6-45e2-88f6-2f8264d697ad HTTP/1.1 May 23 12:34:52.100202 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept: application/json May 23 12:34:52.100202 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept-Encoding: identity May 23 12:34:52.100202 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Connection: close May 23 12:34:52.100202 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Length: 0 May 23 12:34:52.100202 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Type: application/json May 23 12:34:52.100202 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Host: 10.222.0.16 May 23 12:34:52.100202 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Openstack-System-Scope: None May 23 12:34:52.100202 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: User-Agent: python-urllib3/1.26.9 May 23 12:34:52.100202 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Auth-Token: gAAAAABii39RP2e9VPqI4hfi-HfmYmctLlNcyNhFMt8PL3kDF7sLMulfB6m7aze4Pojs7EUFzzAKUDY7xiZLBNBhPEKY9Y7Prur1LpE7s5vKE9Od-FKPiw_V3Ge_40SBTd025ss9GlHizWhlJ9p1z_waRZf9OJ2Sght7KTqbAyigLyZzfPBZplY May 23 12:34:52.100202 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Id: None May 23 12:34:52.100202 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Name: None May 23 12:34:52.100202 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Identity-Status: Confirmed May 23 12:34:52.100202 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Is-Admin-Project: True May 23 12:34:52.100202 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Id: default May 23 12:34:52.100202 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Name: Default May 23 12:34:52.100202 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Id: 61516a3c24f543d68bdb3724a11f7042 May 23 12:34:52.100202 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Name: tempest-VolumesNegativeTest-1214720988 May 23 12:34:52.100202 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Role: member,reader May 23 12:34:52.100202 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Roles: member,reader May 23 12:34:52.102693 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/61516a3c24f543d68bdb3724a11f7042"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/61516a3c24f543d68bdb3724a11f7042"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_61516a3c24f543d68bdb3724a11f7042", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/61516a3c24f543d68bdb3724a11f7042"}]}] May 23 12:34:52.102693 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant: tempest-VolumesNegativeTest-1214720988 May 23 12:34:52.102693 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Id: 61516a3c24f543d68bdb3724a11f7042 May 23 12:34:52.102693 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Name: tempest-VolumesNegativeTest-1214720988 May 23 12:34:52.102693 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User: tempest-VolumesNegativeTest-1214720988-project May 23 12:34:52.102693 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Id: default May 23 12:34:52.102693 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Name: Default May 23 12:34:52.102693 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Id: c819599f00844589b2957d9587c62d11 May 23 12:34:52.102693 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Name: tempest-VolumesNegativeTest-1214720988-project May 23 12:34:52.102693 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: method: > May 23 12:34:52.102693 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: exception: Instance 573d21c5-1aa6-45e2-88f6-2f8264d697ad could not be found. May 23 12:34:52.102693 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: action_args: {'id': '573d21c5-1aa6-45e2-88f6-2f8264d697ad'} May 23 12:34:52.103569 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:34:52.103569 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:34:52.103569 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:34:52.103569 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:34:52.103569 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:34:52.103569 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:34:52.103569 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:34:52.103569 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:34:52.103569 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:34:52.103569 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:34:52.103569 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 573d21c5-1aa6-45e2-88f6-2f8264d697ad could not be found. May 23 12:34:52.103569 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:34:52.103569 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:34:52.103569 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:34:52.103569 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:34:52.103569 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:34:52.103569 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:34:52.103569 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:34:52.103569 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:34:52.103569 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:34:52.105512 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:34:52.105512 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:34:52.105512 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:34:52.105512 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:34:52.105512 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:34:52.105512 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:34:52.105512 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:34:52.105512 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 573d21c5-1aa6-45e2-88f6-2f8264d697ad could not be found. May 23 12:34:52.105512 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:34:52.105512 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:34:52.105512 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:34:52.105512 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:34:52.105512 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:34:52.105512 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:34:52.105512 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:34:52.105512 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:34:52.105512 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 573d21c5-1aa6-45e2-88f6-2f8264d697ad could not be found. May 23 12:34:52.105512 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:34:52.106909 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-7534b9e5-a0a8-465f-a837-f27880092011 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] Returning 404 to user: Instance 573d21c5-1aa6-45e2-88f6-2f8264d697ad could not be found. {{(pid=124200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:34:52.106909 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-7534b9e5-a0a8-465f-a837-f27880092011 tempest-VolumesNegativeTest-1214720988 tempest-VolumesNegativeTest-1214720988-project] 10.222.0.16 "GET /compute/v2.1/servers/573d21c5-1aa6-45e2-88f6-2f8264d697ad" status: 404 len: 111 microversion: 2.1 time: 0.038553 May 23 12:34:52.106909 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 105/204] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:52 2022] GET /compute/v2.1/servers/573d21c5-1aa6-45e2-88f6-2f8264d697ad => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:34:52.538776 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-551b5a9d-a4f2-4b07-bcbf-b65ac37e4086 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:52.539585 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-551b5a9d-a4f2-4b07-bcbf-b65ac37e4086 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:52.547635 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-551b5a9d-a4f2-4b07-bcbf-b65ac37e4086 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:52.548142 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-551b5a9d-a4f2-4b07-bcbf-b65ac37e4086 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:52.548960 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-551b5a9d-a4f2-4b07-bcbf-b65ac37e4086 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:52.549610 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-551b5a9d-a4f2-4b07-bcbf-b65ac37e4086 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:52.703474 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-551b5a9d-a4f2-4b07-bcbf-b65ac37e4086 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:52.720517 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-551b5a9d-a4f2-4b07-bcbf-b65ac37e4086 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1521 microversion: 2.1 time: 0.185395 May 23 12:34:52.721654 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 100/205] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:52 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:53.743541 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-edd20227-449e-441d-8b54-41870da96593 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:53.744647 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-edd20227-449e-441d-8b54-41870da96593 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:53.766426 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-edd20227-449e-441d-8b54-41870da96593 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:53.768758 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-edd20227-449e-441d-8b54-41870da96593 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:53.770797 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-edd20227-449e-441d-8b54-41870da96593 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:53.771578 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-edd20227-449e-441d-8b54-41870da96593 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:53.989143 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-edd20227-449e-441d-8b54-41870da96593 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:54.002647 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-edd20227-449e-441d-8b54-41870da96593 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1521 microversion: 2.1 time: 0.266279 May 23 12:34:54.003815 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 106/206] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:53 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:55.020912 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-a3081223-8748-404d-bb98-2c11dae13d33 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:55.023555 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-a3081223-8748-404d-bb98-2c11dae13d33 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:55.034047 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a3081223-8748-404d-bb98-2c11dae13d33 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:55.034678 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a3081223-8748-404d-bb98-2c11dae13d33 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:55.036114 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a3081223-8748-404d-bb98-2c11dae13d33 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:55.036804 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a3081223-8748-404d-bb98-2c11dae13d33 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:55.225781 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-a3081223-8748-404d-bb98-2c11dae13d33 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:55.239138 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-a3081223-8748-404d-bb98-2c11dae13d33 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1521 microversion: 2.1 time: 0.221638 May 23 12:34:55.240362 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 101/207] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:55 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:56.260736 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-7740fa13-2b42-4929-b5f3-4bf7c5008439 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:56.261396 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-7740fa13-2b42-4929-b5f3-4bf7c5008439 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:56.268281 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7740fa13-2b42-4929-b5f3-4bf7c5008439 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:56.273093 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7740fa13-2b42-4929-b5f3-4bf7c5008439 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:56.274506 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7740fa13-2b42-4929-b5f3-4bf7c5008439 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:56.274986 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7740fa13-2b42-4929-b5f3-4bf7c5008439 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:56.513339 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-7740fa13-2b42-4929-b5f3-4bf7c5008439 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:56.525585 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-7740fa13-2b42-4929-b5f3-4bf7c5008439 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1521 microversion: 2.1 time: 0.271962 May 23 12:34:56.526177 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 107/208] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:56 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:57.548018 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-855d96d2-e722-405c-ae3a-49c07270089f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:57.549347 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-855d96d2-e722-405c-ae3a-49c07270089f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:57.552722 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_api:SELECT=54 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:57.558290 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-855d96d2-e722-405c-ae3a-49c07270089f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:57.558840 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-855d96d2-e722-405c-ae3a-49c07270089f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:57.559695 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-855d96d2-e722-405c-ae3a-49c07270089f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:57.560747 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-855d96d2-e722-405c-ae3a-49c07270089f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:57.735637 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-855d96d2-e722-405c-ae3a-49c07270089f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:57.747876 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-855d96d2-e722-405c-ae3a-49c07270089f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1521 microversion: 2.1 time: 0.207656 May 23 12:34:57.759707 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 102/209] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:57 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:34:58.765781 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-a8a62252-fdd1-4798-ba2d-e14781c91211 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:58.766320 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-a8a62252-fdd1-4798-ba2d-e14781c91211 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:58.772882 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a8a62252-fdd1-4798-ba2d-e14781c91211 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:58.773321 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a8a62252-fdd1-4798-ba2d-e14781c91211 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:58.774078 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a8a62252-fdd1-4798-ba2d-e14781c91211 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:58.774512 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a8a62252-fdd1-4798-ba2d-e14781c91211 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:58.904623 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-a8a62252-fdd1-4798-ba2d-e14781c91211 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:58.912105 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-a8a62252-fdd1-4798-ba2d-e14781c91211 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1501 microversion: 2.1 time: 0.150717 May 23 12:34:58.912706 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 108/210] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:58 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1501 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:34:58.929518 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-ea7d34fd-101c-4857-b582-5220a6f96d42 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:34:58.930222 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-ea7d34fd-101c-4857-b582-5220a6f96d42 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:34:58.936558 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ea7d34fd-101c-4857-b582-5220a6f96d42 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:58.937011 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ea7d34fd-101c-4857-b582-5220a6f96d42 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:58.937792 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ea7d34fd-101c-4857-b582-5220a6f96d42 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:34:58.938231 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ea7d34fd-101c-4857-b582-5220a6f96d42 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:34:58.941008 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell1:SELECT=100 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:59.081253 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-ea7d34fd-101c-4857-b582-5220a6f96d42 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:34:59.088971 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-ea7d34fd-101c-4857-b582-5220a6f96d42 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1517 microversion: 2.1 time: 0.163972 May 23 12:34:59.089556 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 103/211] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:34:58 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:35:01.516998 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-cabef775-662a-4109-95b4-d9f821ae58dd tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:35:01.517938 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-cabef775-662a-4109-95b4-d9f821ae58dd tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:01.525162 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-cabef775-662a-4109-95b4-d9f821ae58dd tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:01.525602 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-cabef775-662a-4109-95b4-d9f821ae58dd tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:01.526373 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-cabef775-662a-4109-95b4-d9f821ae58dd tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:01.526804 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-cabef775-662a-4109-95b4-d9f821ae58dd tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:01.550840 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.objects.instance [None req-cabef775-662a-4109-95b4-d9f821ae58dd tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lazy-loading 'flavor' on Instance uuid 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa {{(pid=124200) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:35:01.719894 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-cabef775-662a-4109-95b4-d9f821ae58dd tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "POST /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa/action" status: 200 len: 32 microversion: 2.1 time: 0.206902 May 23 12:35:01.724717 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 109/212] 10.222.0.16 () {60 vars in 1277 bytes} [Mon May 23 12:35:01 2022] POST /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa/action => generated 32 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 23 12:35:01.730308 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-a2e345c2-2284-416e-b2fb-7b71bd8dcec9 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:01.730924 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-a2e345c2-2284-416e-b2fb-7b71bd8dcec9 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:01.736990 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a2e345c2-2284-416e-b2fb-7b71bd8dcec9 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:01.737427 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a2e345c2-2284-416e-b2fb-7b71bd8dcec9 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:01.738214 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a2e345c2-2284-416e-b2fb-7b71bd8dcec9 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:01.738729 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a2e345c2-2284-416e-b2fb-7b71bd8dcec9 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:01.882509 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-a2e345c2-2284-416e-b2fb-7b71bd8dcec9 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:01.893685 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-a2e345c2-2284-416e-b2fb-7b71bd8dcec9 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1523 microversion: 2.1 time: 0.167407 May 23 12:35:01.894346 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 104/213] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:01 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:02.914403 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-91142f76-939a-4049-b7a5-c757942fb666 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:02.915119 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-91142f76-939a-4049-b7a5-c757942fb666 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:02.922101 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-91142f76-939a-4049-b7a5-c757942fb666 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:02.922596 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-91142f76-939a-4049-b7a5-c757942fb666 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:02.923379 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-91142f76-939a-4049-b7a5-c757942fb666 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:02.923823 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-91142f76-939a-4049-b7a5-c757942fb666 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:03.063819 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-91142f76-939a-4049-b7a5-c757942fb666 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:03.072027 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-91142f76-939a-4049-b7a5-c757942fb666 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1523 microversion: 2.1 time: 0.162874 May 23 12:35:03.072625 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 110/214] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:02 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:04.089803 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b1d26d6c-d86e-4cde-9f72-fbce0cfaffb3 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:04.090330 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-b1d26d6c-d86e-4cde-9f72-fbce0cfaffb3 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:04.096410 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b1d26d6c-d86e-4cde-9f72-fbce0cfaffb3 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:04.096859 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b1d26d6c-d86e-4cde-9f72-fbce0cfaffb3 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:04.097628 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b1d26d6c-d86e-4cde-9f72-fbce0cfaffb3 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:04.098058 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b1d26d6c-d86e-4cde-9f72-fbce0cfaffb3 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:04.229945 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b1d26d6c-d86e-4cde-9f72-fbce0cfaffb3 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:04.238326 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b1d26d6c-d86e-4cde-9f72-fbce0cfaffb3 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1523 microversion: 2.1 time: 0.152411 May 23 12:35:04.238922 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 105/215] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:04 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:05.261876 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-49783fbe-6710-4c9d-905d-acb900920557 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:05.262742 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-49783fbe-6710-4c9d-905d-acb900920557 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:05.270402 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-49783fbe-6710-4c9d-905d-acb900920557 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:05.271826 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-49783fbe-6710-4c9d-905d-acb900920557 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:05.273956 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-49783fbe-6710-4c9d-905d-acb900920557 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:05.274416 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-49783fbe-6710-4c9d-905d-acb900920557 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:05.435357 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-49783fbe-6710-4c9d-905d-acb900920557 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:05.445590 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-49783fbe-6710-4c9d-905d-acb900920557 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1523 microversion: 2.1 time: 0.194271 May 23 12:35:05.446328 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 111/216] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:05 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1523 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:06.463187 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-67a39697-1968-47f4-9e6c-fb00f0bc4cb6 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:06.463824 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-67a39697-1968-47f4-9e6c-fb00f0bc4cb6 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:06.470191 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-67a39697-1968-47f4-9e6c-fb00f0bc4cb6 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:06.470636 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-67a39697-1968-47f4-9e6c-fb00f0bc4cb6 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:06.471412 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-67a39697-1968-47f4-9e6c-fb00f0bc4cb6 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:06.472027 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-67a39697-1968-47f4-9e6c-fb00f0bc4cb6 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:06.887228 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-67a39697-1968-47f4-9e6c-fb00f0bc4cb6 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:06.896904 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-67a39697-1968-47f4-9e6c-fb00f0bc4cb6 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1523 microversion: 2.1 time: 0.437820 May 23 12:35:06.897686 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 106/217] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:06 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1523 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:35:07.915441 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-32cfa38a-c626-448b-88e6-673053aa061f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:07.915975 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-32cfa38a-c626-448b-88e6-673053aa061f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:07.922758 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-32cfa38a-c626-448b-88e6-673053aa061f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:07.923213 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-32cfa38a-c626-448b-88e6-673053aa061f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:07.924800 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-32cfa38a-c626-448b-88e6-673053aa061f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:07.924800 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-32cfa38a-c626-448b-88e6-673053aa061f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:08.076640 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-32cfa38a-c626-448b-88e6-673053aa061f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:08.087199 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-32cfa38a-c626-448b-88e6-673053aa061f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1523 microversion: 2.1 time: 0.176156 May 23 12:35:08.087913 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 112/218] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:07 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:09.105453 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-1e16db1b-1254-4fa3-8a1a-eb906e252b11 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:09.106666 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-1e16db1b-1254-4fa3-8a1a-eb906e252b11 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:09.112855 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1e16db1b-1254-4fa3-8a1a-eb906e252b11 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:09.113335 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1e16db1b-1254-4fa3-8a1a-eb906e252b11 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:09.114112 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1e16db1b-1254-4fa3-8a1a-eb906e252b11 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:09.114549 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1e16db1b-1254-4fa3-8a1a-eb906e252b11 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:09.255016 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1e16db1b-1254-4fa3-8a1a-eb906e252b11 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:09.267823 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-1e16db1b-1254-4fa3-8a1a-eb906e252b11 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1523 microversion: 2.1 time: 0.166112 May 23 12:35:09.268458 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 107/219] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:09 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:10.286019 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-41f70ebb-18ce-4872-8523-ff9794795d1c tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:10.286553 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-41f70ebb-18ce-4872-8523-ff9794795d1c tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:10.288994 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:10.296038 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-41f70ebb-18ce-4872-8523-ff9794795d1c tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:10.296506 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-41f70ebb-18ce-4872-8523-ff9794795d1c tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:10.297720 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-41f70ebb-18ce-4872-8523-ff9794795d1c tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:10.297720 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-41f70ebb-18ce-4872-8523-ff9794795d1c tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:10.301175 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:10.435812 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-41f70ebb-18ce-4872-8523-ff9794795d1c tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:10.443405 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-41f70ebb-18ce-4872-8523-ff9794795d1c tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1523 microversion: 2.1 time: 0.161337 May 23 12:35:10.443974 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 113/220] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:10 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:11.178560 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-2732ad91-2a46-4d77-82a0-9c6a8dda17d3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:11.179117 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-2732ad91-2a46-4d77-82a0-9c6a8dda17d3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:11.186072 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2732ad91-2a46-4d77-82a0-9c6a8dda17d3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:11.186530 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2732ad91-2a46-4d77-82a0-9c6a8dda17d3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:11.187315 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2732ad91-2a46-4d77-82a0-9c6a8dda17d3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:11.187756 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2732ad91-2a46-4d77-82a0-9c6a8dda17d3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:11.214979 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-2732ad91-2a46-4d77-82a0-9c6a8dda17d3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45/ips" status: 200 len: 152 microversion: 2.20 time: 0.040323 May 23 12:35:11.215756 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 108/221] 10.222.0.16 () {60 vars in 1288 bytes} [Mon May 23 12:35:11 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 12:35:11.462658 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-34d11739-eadd-4606-b3fe-9c4bf87813ad tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:11.463202 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-34d11739-eadd-4606-b3fe-9c4bf87813ad tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:11.470043 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-34d11739-eadd-4606-b3fe-9c4bf87813ad tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:11.470494 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-34d11739-eadd-4606-b3fe-9c4bf87813ad tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:11.471281 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-34d11739-eadd-4606-b3fe-9c4bf87813ad tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:11.471977 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-34d11739-eadd-4606-b3fe-9c4bf87813ad tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:11.611989 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-34d11739-eadd-4606-b3fe-9c4bf87813ad tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:11.620895 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-34d11739-eadd-4606-b3fe-9c4bf87813ad tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1523 microversion: 2.1 time: 0.162909 May 23 12:35:11.624469 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 114/222] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:11 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:12.642436 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-83c5f8f2-6704-4285-a2ce-97bb097db77e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:12.643037 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-83c5f8f2-6704-4285-a2ce-97bb097db77e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:12.650048 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-83c5f8f2-6704-4285-a2ce-97bb097db77e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:12.650509 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-83c5f8f2-6704-4285-a2ce-97bb097db77e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:12.651277 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-83c5f8f2-6704-4285-a2ce-97bb097db77e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:12.651709 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-83c5f8f2-6704-4285-a2ce-97bb097db77e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:12.787781 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-83c5f8f2-6704-4285-a2ce-97bb097db77e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:12.795586 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-83c5f8f2-6704-4285-a2ce-97bb097db77e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1523 microversion: 2.1 time: 0.156959 May 23 12:35:12.796153 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 109/223] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:12 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:13.812749 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-2c81401a-8d01-4a5f-8319-4d04b949f870 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:13.813380 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-2c81401a-8d01-4a5f-8319-4d04b949f870 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:13.820037 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2c81401a-8d01-4a5f-8319-4d04b949f870 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:13.820575 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2c81401a-8d01-4a5f-8319-4d04b949f870 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:13.821356 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2c81401a-8d01-4a5f-8319-4d04b949f870 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:13.821793 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2c81401a-8d01-4a5f-8319-4d04b949f870 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:13.954839 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-2c81401a-8d01-4a5f-8319-4d04b949f870 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:13.963092 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-2c81401a-8d01-4a5f-8319-4d04b949f870 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1523 microversion: 2.1 time: 0.154269 May 23 12:35:13.963670 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 115/224] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:13 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:14.980747 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-87df67b2-1c17-49d7-9721-da40b2e9879d tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:14.981366 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-87df67b2-1c17-49d7-9721-da40b2e9879d tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:14.987382 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-87df67b2-1c17-49d7-9721-da40b2e9879d tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:14.987995 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-87df67b2-1c17-49d7-9721-da40b2e9879d tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:14.988643 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-87df67b2-1c17-49d7-9721-da40b2e9879d tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:14.989085 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-87df67b2-1c17-49d7-9721-da40b2e9879d tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:15.135228 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-87df67b2-1c17-49d7-9721-da40b2e9879d tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:15.142931 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-87df67b2-1c17-49d7-9721-da40b2e9879d tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1523 microversion: 2.1 time: 0.166187 May 23 12:35:15.143508 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 110/225] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:14 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:16.161339 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-22f8125a-6fda-4361-9191-cb62d383438d tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:16.161969 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-22f8125a-6fda-4361-9191-cb62d383438d tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:16.169334 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-22f8125a-6fda-4361-9191-cb62d383438d tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:16.169790 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-22f8125a-6fda-4361-9191-cb62d383438d tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:16.170581 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-22f8125a-6fda-4361-9191-cb62d383438d tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:16.171032 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-22f8125a-6fda-4361-9191-cb62d383438d tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:16.314692 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-22f8125a-6fda-4361-9191-cb62d383438d tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:16.322269 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-22f8125a-6fda-4361-9191-cb62d383438d tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1523 microversion: 2.1 time: 0.165263 May 23 12:35:16.322832 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 116/226] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:16 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:17.183010 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-007f14e4-21ee-427a-8b71-f38f71cbaf0f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:35:17.183604 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-007f14e4-21ee-427a-8b71-f38f71cbaf0f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:17.189820 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-007f14e4-21ee-427a-8b71-f38f71cbaf0f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:17.190263 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-007f14e4-21ee-427a-8b71-f38f71cbaf0f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:17.191028 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-007f14e4-21ee-427a-8b71-f38f71cbaf0f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:17.191460 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-007f14e4-21ee-427a-8b71-f38f71cbaf0f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:17.215999 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.objects.instance [None req-007f14e4-21ee-427a-8b71-f38f71cbaf0f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lazy-loading 'flavor' on Instance uuid ce37af9c-e5f8-4233-97f3-4280a2114e45 {{(pid=124199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:35:17.339638 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-26e1893b-9082-479e-97f1-96397bfb4f39 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:17.340298 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-26e1893b-9082-479e-97f1-96397bfb4f39 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:17.348878 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-26e1893b-9082-479e-97f1-96397bfb4f39 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:17.349561 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-26e1893b-9082-479e-97f1-96397bfb4f39 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:17.350571 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-26e1893b-9082-479e-97f1-96397bfb4f39 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:17.351076 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-26e1893b-9082-479e-97f1-96397bfb4f39 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:17.496561 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-007f14e4-21ee-427a-8b71-f38f71cbaf0f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "POST /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45/action" status: 202 len: 0 microversion: 2.20 time: 0.317822 May 23 12:35:17.500445 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 111/227] 10.222.0.16 () {62 vars in 1318 bytes} [Mon May 23 12:35:17 2022] POST /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45/action => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 23 12:35:17.501546 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-26e1893b-9082-479e-97f1-96397bfb4f39 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:17.507288 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-8ed1f35e-5dc2-4115-a362-81f29328e983 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:17.509113 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-8ed1f35e-5dc2-4115-a362-81f29328e983 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:17.513733 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-26e1893b-9082-479e-97f1-96397bfb4f39 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1523 microversion: 2.1 time: 0.178541 May 23 12:35:17.522624 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 117/228] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:17 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:35:17.522831 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8ed1f35e-5dc2-4115-a362-81f29328e983 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:17.522831 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8ed1f35e-5dc2-4115-a362-81f29328e983 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:17.522831 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8ed1f35e-5dc2-4115-a362-81f29328e983 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:17.522831 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8ed1f35e-5dc2-4115-a362-81f29328e983 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:17.661006 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-8ed1f35e-5dc2-4115-a362-81f29328e983 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:17.670262 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-8ed1f35e-5dc2-4115-a362-81f29328e983 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:17.671768 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-8ed1f35e-5dc2-4115-a362-81f29328e983 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:17.672975 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-8ed1f35e-5dc2-4115-a362-81f29328e983 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1725 microversion: 2.20 time: 0.171377 May 23 12:35:17.673547 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 112/229] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:35:17 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:35:18.222541 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-e25047bb-8bda-40a9-824f-5067cccd3d7e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:18.223138 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-e25047bb-8bda-40a9-824f-5067cccd3d7e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:18.234730 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e25047bb-8bda-40a9-824f-5067cccd3d7e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:18.235425 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e25047bb-8bda-40a9-824f-5067cccd3d7e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:18.236419 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e25047bb-8bda-40a9-824f-5067cccd3d7e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:18.236858 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e25047bb-8bda-40a9-824f-5067cccd3d7e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:18.263299 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-e25047bb-8bda-40a9-824f-5067cccd3d7e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5/ips" status: 200 len: 149 microversion: 2.1 time: 0.046161 May 23 12:35:18.270025 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 118/230] 10.222.0.16 () {58 vars in 1247 bytes} [Mon May 23 12:35:18 2022] GET /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5/ips => generated 149 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:35:18.534783 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-070fe455-b580-4238-bb53-a5272ab5807e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:18.535505 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-070fe455-b580-4238-bb53-a5272ab5807e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:18.543254 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-070fe455-b580-4238-bb53-a5272ab5807e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:18.543706 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-070fe455-b580-4238-bb53-a5272ab5807e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:18.544521 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-070fe455-b580-4238-bb53-a5272ab5807e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:18.545322 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-070fe455-b580-4238-bb53-a5272ab5807e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:18.691928 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-99a98bb9-2e0b-48db-8529-8b24667522af tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:18.692641 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-99a98bb9-2e0b-48db-8529-8b24667522af tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:18.700144 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-99a98bb9-2e0b-48db-8529-8b24667522af tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:18.700638 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-99a98bb9-2e0b-48db-8529-8b24667522af tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:18.701686 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-99a98bb9-2e0b-48db-8529-8b24667522af tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:18.702437 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-99a98bb9-2e0b-48db-8529-8b24667522af tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:18.875693 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-070fe455-b580-4238-bb53-a5272ab5807e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:18.884059 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-070fe455-b580-4238-bb53-a5272ab5807e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1523 microversion: 2.1 time: 0.355133 May 23 12:35:18.884668 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 113/231] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:18 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1523 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:18.967344 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-99a98bb9-2e0b-48db-8529-8b24667522af tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:18.975950 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-99a98bb9-2e0b-48db-8529-8b24667522af tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:18.977617 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-99a98bb9-2e0b-48db-8529-8b24667522af tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:18.978811 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-99a98bb9-2e0b-48db-8529-8b24667522af tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1725 microversion: 2.20 time: 0.291444 May 23 12:35:18.979375 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 119/232] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:35:18 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1725 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:35:19.904568 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-ab7daded-316f-4a3c-90c7-ed92ec9dec98 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:19.905188 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-ab7daded-316f-4a3c-90c7-ed92ec9dec98 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:19.913538 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ab7daded-316f-4a3c-90c7-ed92ec9dec98 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:19.913538 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ab7daded-316f-4a3c-90c7-ed92ec9dec98 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:19.913538 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ab7daded-316f-4a3c-90c7-ed92ec9dec98 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:19.913538 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ab7daded-316f-4a3c-90c7-ed92ec9dec98 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:19.933397 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-d55564b4-4b6a-4cef-be86-99afdd2d8fc1 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81415a1c-c003-43c5-8d76-5e65aacba281"}} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:35:19.934911 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-d55564b4-4b6a-4cef-be86-99afdd2d8fc1 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:19.942173 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d55564b4-4b6a-4cef-be86-99afdd2d8fc1 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:19.942776 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d55564b4-4b6a-4cef-be86-99afdd2d8fc1 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:19.943783 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d55564b4-4b6a-4cef-be86-99afdd2d8fc1 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:19.944432 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d55564b4-4b6a-4cef-be86-99afdd2d8fc1 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:20.074272 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-ab7daded-316f-4a3c-90c7-ed92ec9dec98 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:20.083637 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-ab7daded-316f-4a3c-90c7-ed92ec9dec98 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1523 microversion: 2.1 time: 0.186150 May 23 12:35:20.084249 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 114/233] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:19 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:20.089609 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-59eebc82-7192-4f0e-9bed-b761330e7454 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:20.090455 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-59eebc82-7192-4f0e-9bed-b761330e7454 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:20.098381 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-59eebc82-7192-4f0e-9bed-b761330e7454 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:20.098834 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-59eebc82-7192-4f0e-9bed-b761330e7454 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:20.099698 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-59eebc82-7192-4f0e-9bed-b761330e7454 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:20.100041 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-59eebc82-7192-4f0e-9bed-b761330e7454 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:20.257914 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-59eebc82-7192-4f0e-9bed-b761330e7454 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:20.267313 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-59eebc82-7192-4f0e-9bed-b761330e7454 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:20.268865 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-59eebc82-7192-4f0e-9bed-b761330e7454 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:20.270039 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-59eebc82-7192-4f0e-9bed-b761330e7454 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1725 microversion: 2.20 time: 0.184875 May 23 12:35:20.270604 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 115/234] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:35:20 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:35:20.284100 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-d55564b4-4b6a-4cef-be86-99afdd2d8fc1 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "POST /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.356370 May 23 12:35:20.284916 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 120/235] 10.222.0.16 () {60 vars in 1322 bytes} [Mon May 23 12:35:19 2022] POST /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5/os-volume_attachments => generated 194 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:35:21.100858 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-e6155a63-58fe-45f0-832a-e618e1d7011b tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:21.101682 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-e6155a63-58fe-45f0-832a-e618e1d7011b tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:21.107829 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e6155a63-58fe-45f0-832a-e618e1d7011b tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:21.108327 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e6155a63-58fe-45f0-832a-e618e1d7011b tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:21.109105 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e6155a63-58fe-45f0-832a-e618e1d7011b tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:21.109545 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e6155a63-58fe-45f0-832a-e618e1d7011b tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:21.252196 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-e6155a63-58fe-45f0-832a-e618e1d7011b tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:21.260545 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-e6155a63-58fe-45f0-832a-e618e1d7011b tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1523 microversion: 2.1 time: 0.163575 May 23 12:35:21.261137 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 116/236] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:21 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:21.292925 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-c8602dbf-d3f2-46ce-bcf7-1d43a072ca1a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:21.293611 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-c8602dbf-d3f2-46ce-bcf7-1d43a072ca1a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:21.299819 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c8602dbf-d3f2-46ce-bcf7-1d43a072ca1a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:21.300301 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c8602dbf-d3f2-46ce-bcf7-1d43a072ca1a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:21.301068 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c8602dbf-d3f2-46ce-bcf7-1d43a072ca1a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:21.301498 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c8602dbf-d3f2-46ce-bcf7-1d43a072ca1a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:21.459625 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-c8602dbf-d3f2-46ce-bcf7-1d43a072ca1a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:21.468096 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-c8602dbf-d3f2-46ce-bcf7-1d43a072ca1a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:21.469645 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-c8602dbf-d3f2-46ce-bcf7-1d43a072ca1a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:21.470825 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-c8602dbf-d3f2-46ce-bcf7-1d43a072ca1a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1725 microversion: 2.20 time: 0.182730 May 23 12:35:21.471395 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 121/237] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:35:21 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:35:21.641145 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-95198074-e097-49ee-929f-85476f8f05f1 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:21.641654 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-95198074-e097-49ee-929f-85476f8f05f1 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:21.649224 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-95198074-e097-49ee-929f-85476f8f05f1 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:21.649683 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-95198074-e097-49ee-929f-85476f8f05f1 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:21.650470 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-95198074-e097-49ee-929f-85476f8f05f1 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:21.650957 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-95198074-e097-49ee-929f-85476f8f05f1 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:21.678954 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-95198074-e097-49ee-929f-85476f8f05f1 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e/ips" status: 200 len: 144 microversion: 2.1 time: 0.041970 May 23 12:35:21.679648 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 117/238] 10.222.0.16 () {58 vars in 1247 bytes} [Mon May 23 12:35:21 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e/ips => generated 144 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:35:22.278174 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-8b23f9cd-cff1-458b-86ee-ec9ca806c2a2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:22.278793 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-8b23f9cd-cff1-458b-86ee-ec9ca806c2a2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:22.285611 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8b23f9cd-cff1-458b-86ee-ec9ca806c2a2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:22.286061 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8b23f9cd-cff1-458b-86ee-ec9ca806c2a2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:22.286846 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8b23f9cd-cff1-458b-86ee-ec9ca806c2a2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:22.287280 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8b23f9cd-cff1-458b-86ee-ec9ca806c2a2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:22.428339 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-8b23f9cd-cff1-458b-86ee-ec9ca806c2a2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:22.436728 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-8b23f9cd-cff1-458b-86ee-ec9ca806c2a2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1523 microversion: 2.1 time: 0.162897 May 23 12:35:22.437307 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 122/239] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:22 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:22.489465 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-3ee7e483-8e62-4959-a927-149368912317 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:22.490071 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-3ee7e483-8e62-4959-a927-149368912317 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:22.496391 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3ee7e483-8e62-4959-a927-149368912317 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:22.496833 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3ee7e483-8e62-4959-a927-149368912317 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:22.497594 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3ee7e483-8e62-4959-a927-149368912317 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:22.498029 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3ee7e483-8e62-4959-a927-149368912317 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:22.513746 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:22.631336 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-3ee7e483-8e62-4959-a927-149368912317 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:22.640518 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-3ee7e483-8e62-4959-a927-149368912317 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:22.641823 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-3ee7e483-8e62-4959-a927-149368912317 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:22.642991 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-3ee7e483-8e62-4959-a927-149368912317 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1725 microversion: 2.20 time: 0.157479 May 23 12:35:22.643547 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 118/240] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:35:22 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:35:23.455775 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-fd3cbb12-83a2-42e1-bfde-156d526dac1d tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:23.456404 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-fd3cbb12-83a2-42e1-bfde-156d526dac1d tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:23.463875 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-fd3cbb12-83a2-42e1-bfde-156d526dac1d tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:23.464354 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-fd3cbb12-83a2-42e1-bfde-156d526dac1d tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:23.465117 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-fd3cbb12-83a2-42e1-bfde-156d526dac1d tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:23.465547 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-fd3cbb12-83a2-42e1-bfde-156d526dac1d tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:23.613464 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-fd3cbb12-83a2-42e1-bfde-156d526dac1d tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:23.621347 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-fd3cbb12-83a2-42e1-bfde-156d526dac1d tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1523 microversion: 2.1 time: 0.169350 May 23 12:35:23.621920 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 123/241] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:23 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:23.662022 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-080e0ca9-efb1-4c38-9b86-d6dec3cf1fb0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:23.662652 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-080e0ca9-efb1-4c38-9b86-d6dec3cf1fb0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:23.669788 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-080e0ca9-efb1-4c38-9b86-d6dec3cf1fb0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:23.670237 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-080e0ca9-efb1-4c38-9b86-d6dec3cf1fb0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:23.671006 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-080e0ca9-efb1-4c38-9b86-d6dec3cf1fb0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:23.671436 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-080e0ca9-efb1-4c38-9b86-d6dec3cf1fb0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:23.806736 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-080e0ca9-efb1-4c38-9b86-d6dec3cf1fb0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:23.814845 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-080e0ca9-efb1-4c38-9b86-d6dec3cf1fb0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:23.816382 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-080e0ca9-efb1-4c38-9b86-d6dec3cf1fb0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:23.817554 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-080e0ca9-efb1-4c38-9b86-d6dec3cf1fb0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1725 microversion: 2.20 time: 0.159566 May 23 12:35:23.818120 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 119/242] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:35:23 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:35:24.640156 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-f8d51ca9-7bca-40d7-8240-1b1f4d6725de tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:24.640814 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-f8d51ca9-7bca-40d7-8240-1b1f4d6725de tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:24.647434 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f8d51ca9-7bca-40d7-8240-1b1f4d6725de tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:24.647879 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f8d51ca9-7bca-40d7-8240-1b1f4d6725de tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:24.649634 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f8d51ca9-7bca-40d7-8240-1b1f4d6725de tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:24.650071 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f8d51ca9-7bca-40d7-8240-1b1f4d6725de tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:24.792732 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-f8d51ca9-7bca-40d7-8240-1b1f4d6725de tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:24.800382 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-f8d51ca9-7bca-40d7-8240-1b1f4d6725de tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1523 microversion: 2.1 time: 0.164832 May 23 12:35:24.800954 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 124/243] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:24 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:24.837215 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-41cf3eb3-6beb-4aad-96c6-2b9850045a3a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:24.837883 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-41cf3eb3-6beb-4aad-96c6-2b9850045a3a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:24.844097 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-41cf3eb3-6beb-4aad-96c6-2b9850045a3a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:24.844573 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-41cf3eb3-6beb-4aad-96c6-2b9850045a3a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:24.845353 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-41cf3eb3-6beb-4aad-96c6-2b9850045a3a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:24.845833 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-41cf3eb3-6beb-4aad-96c6-2b9850045a3a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:24.983467 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-41cf3eb3-6beb-4aad-96c6-2b9850045a3a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:24.991604 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-41cf3eb3-6beb-4aad-96c6-2b9850045a3a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:24.994224 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-41cf3eb3-6beb-4aad-96c6-2b9850045a3a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:24.995110 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-41cf3eb3-6beb-4aad-96c6-2b9850045a3a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1725 microversion: 2.20 time: 0.162877 May 23 12:35:24.995680 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 120/244] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:35:24 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:35:25.817988 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-5e97e49d-cc2f-4710-9b9e-958dc58e5516 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:25.818693 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-5e97e49d-cc2f-4710-9b9e-958dc58e5516 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:25.825568 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5e97e49d-cc2f-4710-9b9e-958dc58e5516 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:25.826271 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5e97e49d-cc2f-4710-9b9e-958dc58e5516 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:25.827055 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5e97e49d-cc2f-4710-9b9e-958dc58e5516 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:25.827499 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5e97e49d-cc2f-4710-9b9e-958dc58e5516 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:25.985223 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-5e97e49d-cc2f-4710-9b9e-958dc58e5516 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:25.998056 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-5e97e49d-cc2f-4710-9b9e-958dc58e5516 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1523 microversion: 2.1 time: 0.183914 May 23 12:35:25.998654 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 125/245] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:25 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:26.014765 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c79bdcdf-7d1b-4db9-b444-f9dde9ce6f75 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:26.016413 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c79bdcdf-7d1b-4db9-b444-f9dde9ce6f75 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:26.022492 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c79bdcdf-7d1b-4db9-b444-f9dde9ce6f75 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:26.022968 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c79bdcdf-7d1b-4db9-b444-f9dde9ce6f75 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:26.024805 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c79bdcdf-7d1b-4db9-b444-f9dde9ce6f75 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:26.025312 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c79bdcdf-7d1b-4db9-b444-f9dde9ce6f75 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:26.188554 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c79bdcdf-7d1b-4db9-b444-f9dde9ce6f75 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:26.197865 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c79bdcdf-7d1b-4db9-b444-f9dde9ce6f75 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:26.199388 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c79bdcdf-7d1b-4db9-b444-f9dde9ce6f75 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:26.200601 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c79bdcdf-7d1b-4db9-b444-f9dde9ce6f75 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1725 microversion: 2.20 time: 0.189678 May 23 12:35:26.201429 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 121/246] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:35:26 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1725 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:35:27.017163 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-f53cbea3-75c4-4e20-a20f-9c8deba03853 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:27.017718 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-f53cbea3-75c4-4e20-a20f-9c8deba03853 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:27.025404 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f53cbea3-75c4-4e20-a20f-9c8deba03853 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:27.025847 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f53cbea3-75c4-4e20-a20f-9c8deba03853 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:27.026629 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f53cbea3-75c4-4e20-a20f-9c8deba03853 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:27.027087 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f53cbea3-75c4-4e20-a20f-9c8deba03853 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:27.165741 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-f53cbea3-75c4-4e20-a20f-9c8deba03853 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:27.173571 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-f53cbea3-75c4-4e20-a20f-9c8deba03853 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1523 microversion: 2.1 time: 0.160342 May 23 12:35:27.174148 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 126/247] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:27 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:27.219685 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-bba896f2-4323-4314-802f-a4b4c51894c1 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:27.220316 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-bba896f2-4323-4314-802f-a4b4c51894c1 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:27.227378 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bba896f2-4323-4314-802f-a4b4c51894c1 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:27.227829 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bba896f2-4323-4314-802f-a4b4c51894c1 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:27.228636 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bba896f2-4323-4314-802f-a4b4c51894c1 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:27.229079 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bba896f2-4323-4314-802f-a4b4c51894c1 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:27.363158 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-bba896f2-4323-4314-802f-a4b4c51894c1 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:27.375011 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-bba896f2-4323-4314-802f-a4b4c51894c1 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:27.376567 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-bba896f2-4323-4314-802f-a4b4c51894c1 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:27.378046 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-bba896f2-4323-4314-802f-a4b4c51894c1 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1725 microversion: 2.20 time: 0.162035 May 23 12:35:27.378046 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 122/248] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:35:27 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:35:28.190899 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-96ddd151-b5ea-4bb2-b0d7-f323026ccd72 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:28.191609 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-96ddd151-b5ea-4bb2-b0d7-f323026ccd72 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:28.200687 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-96ddd151-b5ea-4bb2-b0d7-f323026ccd72 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:28.201455 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-96ddd151-b5ea-4bb2-b0d7-f323026ccd72 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:28.202682 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-96ddd151-b5ea-4bb2-b0d7-f323026ccd72 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:28.202682 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-96ddd151-b5ea-4bb2-b0d7-f323026ccd72 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:28.355755 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-96ddd151-b5ea-4bb2-b0d7-f323026ccd72 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:28.364427 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-96ddd151-b5ea-4bb2-b0d7-f323026ccd72 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1523 microversion: 2.1 time: 0.177337 May 23 12:35:28.365300 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 127/249] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:28 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:28.400001 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-80ebc0d3-dd86-4d93-b435-29c0d8a64467 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:28.402876 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-80ebc0d3-dd86-4d93-b435-29c0d8a64467 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:28.410502 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_api:SELECT=42 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:28.413522 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-80ebc0d3-dd86-4d93-b435-29c0d8a64467 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:28.414702 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-80ebc0d3-dd86-4d93-b435-29c0d8a64467 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:28.417833 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-80ebc0d3-dd86-4d93-b435-29c0d8a64467 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:28.419836 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-80ebc0d3-dd86-4d93-b435-29c0d8a64467 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:28.574025 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-80ebc0d3-dd86-4d93-b435-29c0d8a64467 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:28.584780 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-80ebc0d3-dd86-4d93-b435-29c0d8a64467 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:28.586516 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-80ebc0d3-dd86-4d93-b435-29c0d8a64467 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:28.588139 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-80ebc0d3-dd86-4d93-b435-29c0d8a64467 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1725 microversion: 2.20 time: 0.194052 May 23 12:35:28.588737 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 123/250] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:35:28 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1725 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:35:29.382656 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-4fb247c1-2ab8-45be-9901-30583413c66b tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:29.383706 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-4fb247c1-2ab8-45be-9901-30583413c66b tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:29.390141 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4fb247c1-2ab8-45be-9901-30583413c66b tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:29.390577 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4fb247c1-2ab8-45be-9901-30583413c66b tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:29.391350 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4fb247c1-2ab8-45be-9901-30583413c66b tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:29.391786 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4fb247c1-2ab8-45be-9901-30583413c66b tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:29.500093 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0cdc66a3-f486-4111-b9ad-a04bf6a0ed02 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0abf2e4f-4fa8-4e28-af2e-09430efd7bff"}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:35:29.501541 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-0cdc66a3-f486-4111-b9ad-a04bf6a0ed02 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:29.509371 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0cdc66a3-f486-4111-b9ad-a04bf6a0ed02 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:29.509822 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0cdc66a3-f486-4111-b9ad-a04bf6a0ed02 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:29.510622 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0cdc66a3-f486-4111-b9ad-a04bf6a0ed02 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:29.511730 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0cdc66a3-f486-4111-b9ad-a04bf6a0ed02 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:29.551488 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-4fb247c1-2ab8-45be-9901-30583413c66b tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:29.555465 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:29.560701 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-4fb247c1-2ab8-45be-9901-30583413c66b tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1523 microversion: 2.1 time: 0.181999 May 23 12:35:29.570881 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 128/251] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:29 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1523 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:29.607358 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-654dac14-cd56-4f5e-950e-bc2ad58f5ef0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:29.608037 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-654dac14-cd56-4f5e-950e-bc2ad58f5ef0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:29.615442 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-654dac14-cd56-4f5e-950e-bc2ad58f5ef0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:29.615886 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-654dac14-cd56-4f5e-950e-bc2ad58f5ef0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:29.616713 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-654dac14-cd56-4f5e-950e-bc2ad58f5ef0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:29.617361 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-654dac14-cd56-4f5e-950e-bc2ad58f5ef0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:29.771401 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-654dac14-cd56-4f5e-950e-bc2ad58f5ef0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:29.780510 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-654dac14-cd56-4f5e-950e-bc2ad58f5ef0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:29.782024 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-654dac14-cd56-4f5e-950e-bc2ad58f5ef0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:29.783188 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-654dac14-cd56-4f5e-950e-bc2ad58f5ef0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1725 microversion: 2.20 time: 0.179940 May 23 12:35:29.783747 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 129/252] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:35:29 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1725 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:35:29.825371 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-0cdc66a3-f486-4111-b9ad-a04bf6a0ed02 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "POST /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.329319 May 23 12:35:29.826284 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 124/253] 10.222.0.16 () {60 vars in 1322 bytes} [Mon May 23 12:35:29 2022] POST /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e/os-volume_attachments => generated 194 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:35:29.967351 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-194d73b3-10fe-44e0-972c-26ed0493ec57 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Action: 'create', calling method: .version_select at 0x7f095cc4ad30>, body: {"keypair": {"name": "tempest-keypair-1778784054", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxIso6q2ld5igfcf6dXlhTdXJ9euRpdAbLSOqnQV5mAnDrzQyThWiPTF1oFMzansLkNlBgAR0mKRI2qO1nPUIWuE3t7gPX3Qp5Z8bq7DL5ArS5uQ9vs873M7R+c7BoeMQ=="}} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:35:29.982241 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.quota [None req-194d73b3-10fe-44e0-972c-26ed0493ec57 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Getting quotas for project da82f9c566664cb1a974cf0d1bf1b09d. Resources: {'key_pairs'} {{(pid=124200) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:35:29.987059 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.quota [None req-194d73b3-10fe-44e0-972c-26ed0493ec57 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Getting quotas for user ef222fe025534a9e942f8c5c4ed1e3e7 and project da82f9c566664cb1a974cf0d1bf1b09d. Resources: {'key_pairs'} {{(pid=124200) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:35:30.014688 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-194d73b3-10fe-44e0-972c-26ed0493ec57 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051246 May 23 12:35:30.015565 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 130/254] 10.222.0.16 () {60 vars in 1158 bytes} [Mon May 23 12:35:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:35:30.579893 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-1bb3c758-c7f3-440a-9810-53d375774565 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:30.580927 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-1bb3c758-c7f3-440a-9810-53d375774565 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:30.588726 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1bb3c758-c7f3-440a-9810-53d375774565 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:30.589164 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1bb3c758-c7f3-440a-9810-53d375774565 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:30.589950 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1bb3c758-c7f3-440a-9810-53d375774565 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:30.590387 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1bb3c758-c7f3-440a-9810-53d375774565 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:30.806118 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-57928650-e7ad-4274-b7d7-44c9bd596249 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:30.807352 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-57928650-e7ad-4274-b7d7-44c9bd596249 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:30.813537 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-57928650-e7ad-4274-b7d7-44c9bd596249 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:30.814207 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-57928650-e7ad-4274-b7d7-44c9bd596249 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:30.815151 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-57928650-e7ad-4274-b7d7-44c9bd596249 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:30.815763 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-57928650-e7ad-4274-b7d7-44c9bd596249 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:30.840757 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1bb3c758-c7f3-440a-9810-53d375774565 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:30.850519 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-1bb3c758-c7f3-440a-9810-53d375774565 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1523 microversion: 2.1 time: 0.276024 May 23 12:35:30.851122 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 125/255] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:30 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1523 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:31.045349 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-57928650-e7ad-4274-b7d7-44c9bd596249 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:31.053422 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-57928650-e7ad-4274-b7d7-44c9bd596249 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:31.055034 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-57928650-e7ad-4274-b7d7-44c9bd596249 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:31.056220 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-57928650-e7ad-4274-b7d7-44c9bd596249 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1725 microversion: 2.20 time: 0.255266 May 23 12:35:31.056787 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 131/256] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:35:30 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1725 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:35:31.700266 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-914bfbc7-ca13-490e-9224-b1534c9f9de4 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-582617356", "imageRef": "bb11dfa4-2977-4163-8237-78c871c8437f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "34e447e2-b5a8-48e8-88c3-11c08d0cb74a"}], "security_groups": [{"name": "tempest-securitygroup--1684184452"}], "key_name": "tempest-keypair-1778784054", "user_data": "}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:35:31.829225 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.network.neutron [None req-914bfbc7-ca13-490e-9224-b1534c9f9de4 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] validate_networks() for [('34e447e2-b5a8-48e8-88c3-11c08d0cb74a', None, None, None, None, None)] {{(pid=124199) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 12:35:31.872080 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-fb63ae0c-acc9-4d4a-975d-cd6cc48dc253 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:31.872734 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-fb63ae0c-acc9-4d4a-975d-cd6cc48dc253 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:31.879569 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-fb63ae0c-acc9-4d4a-975d-cd6cc48dc253 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:31.880327 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-fb63ae0c-acc9-4d4a-975d-cd6cc48dc253 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:31.881623 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-fb63ae0c-acc9-4d4a-975d-cd6cc48dc253 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:31.882216 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-fb63ae0c-acc9-4d4a-975d-cd6cc48dc253 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:32.181347 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-fb63ae0c-acc9-4d4a-975d-cd6cc48dc253 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:32.189280 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-fb63ae0c-acc9-4d4a-975d-cd6cc48dc253 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1523 microversion: 2.1 time: 0.322327 May 23 12:35:32.189861 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 132/257] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:31 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1523 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:35:32.194420 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-b3c43953-3144-40a0-b180-5a63b7e38c25 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:32.195156 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-b3c43953-3144-40a0-b180-5a63b7e38c25 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:32.201902 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b3c43953-3144-40a0-b180-5a63b7e38c25 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:32.202355 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b3c43953-3144-40a0-b180-5a63b7e38c25 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:32.203131 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b3c43953-3144-40a0-b180-5a63b7e38c25 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:32.203569 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b3c43953-3144-40a0-b180-5a63b7e38c25 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:32.492629 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-b3c43953-3144-40a0-b180-5a63b7e38c25 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:32.501932 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-b3c43953-3144-40a0-b180-5a63b7e38c25 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:32.503485 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-b3c43953-3144-40a0-b180-5a63b7e38c25 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:32.504895 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-b3c43953-3144-40a0-b180-5a63b7e38c25 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1725 microversion: 2.20 time: 0.314102 May 23 12:35:32.505674 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 133/258] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:35:32 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1725 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:35:32.514834 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-914bfbc7-ca13-490e-9224-b1534c9f9de4 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Flavor limits 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 12:35:32.515258 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-914bfbc7-ca13-490e-9224-b1534c9f9de4 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Image limits 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 12:35:32.515916 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-914bfbc7-ca13-490e-9224-b1534c9f9de4 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Flavor pref 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 12:35:32.516519 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-914bfbc7-ca13-490e-9224-b1534c9f9de4 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Image pref 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 12:35:32.516941 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-914bfbc7-ca13-490e-9224-b1534c9f9de4 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 12:35:32.527990 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-914bfbc7-ca13-490e-9224-b1534c9f9de4 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:32.528478 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-914bfbc7-ca13-490e-9224-b1534c9f9de4 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:32.529288 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-914bfbc7-ca13-490e-9224-b1534c9f9de4 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:32.529720 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-914bfbc7-ca13-490e-9224-b1534c9f9de4 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:32.548736 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-914bfbc7-ca13-490e-9224-b1534c9f9de4 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Getting quotas for project da82f9c566664cb1a974cf0d1bf1b09d. Resources: {'instances', 'cores', 'ram'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:35:32.553022 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-914bfbc7-ca13-490e-9224-b1534c9f9de4 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Getting quotas for user ef222fe025534a9e942f8c5c4ed1e3e7 and project da82f9c566664cb1a974cf0d1bf1b09d. Resources: {'instances', 'cores', 'ram'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:35:32.565484 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-914bfbc7-ca13-490e-9224-b1534c9f9de4 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Going to run 1 instances... {{(pid=124199) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 12:35:32.568140 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-914bfbc7-ca13-490e-9224-b1534c9f9de4 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: a624bb16-d6b7-491a-9724-9a51af12140d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb11dfa4-2977-4163-8237-78c871c8437f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124199) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 12:35:32.636469 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-914bfbc7-ca13-490e-9224-b1534c9f9de4 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.940898 May 23 12:35:32.642047 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 126/259] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 23 12:35:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 943 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 12:35:32.651412 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-829b370f-06e2-4ae5-b4d1-ac1b681ad8af tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:32.652705 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-829b370f-06e2-4ae5-b4d1-ac1b681ad8af tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: a624bb16-d6b7-491a-9724-9a51af12140d] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:32.733932 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-829b370f-06e2-4ae5-b4d1-ac1b681ad8af tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:32.743519 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-829b370f-06e2-4ae5-b4d1-ac1b681ad8af tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d" status: 200 len: 1241 microversion: 2.1 time: 0.099885 May 23 12:35:32.744396 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 134/260] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:32 2022] GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d => generated 1241 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:33.207606 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0559de3f-59a6-48f6-8c81-b87038cd3428 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:33.208355 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-0559de3f-59a6-48f6-8c81-b87038cd3428 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:33.215704 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0559de3f-59a6-48f6-8c81-b87038cd3428 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:33.216161 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0559de3f-59a6-48f6-8c81-b87038cd3428 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:33.216985 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0559de3f-59a6-48f6-8c81-b87038cd3428 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:33.217463 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0559de3f-59a6-48f6-8c81-b87038cd3428 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:33.384642 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0559de3f-59a6-48f6-8c81-b87038cd3428 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:33.395354 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-0559de3f-59a6-48f6-8c81-b87038cd3428 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1523 microversion: 2.1 time: 0.191567 May 23 12:35:33.396750 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 127/261] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:33 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1523 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:33.522931 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-de1efb4a-ff45-468d-b38e-3b5414ba95b6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:33.524071 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-de1efb4a-ff45-468d-b38e-3b5414ba95b6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:33.531685 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-de1efb4a-ff45-468d-b38e-3b5414ba95b6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:33.532136 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-de1efb4a-ff45-468d-b38e-3b5414ba95b6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:33.532939 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-de1efb4a-ff45-468d-b38e-3b5414ba95b6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:33.533375 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-de1efb4a-ff45-468d-b38e-3b5414ba95b6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:33.677422 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-de1efb4a-ff45-468d-b38e-3b5414ba95b6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:33.686331 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-de1efb4a-ff45-468d-b38e-3b5414ba95b6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:33.687835 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-de1efb4a-ff45-468d-b38e-3b5414ba95b6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:33.689026 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-de1efb4a-ff45-468d-b38e-3b5414ba95b6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1725 microversion: 2.20 time: 0.169991 May 23 12:35:33.689588 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 135/262] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:35:33 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:35:33.761268 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-589cc46f-83a5-4c04-a160-01c663d14d34 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:33.762330 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-589cc46f-83a5-4c04-a160-01c663d14d34 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: a624bb16-d6b7-491a-9724-9a51af12140d] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:33.769200 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-589cc46f-83a5-4c04-a160-01c663d14d34 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:33.769725 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-589cc46f-83a5-4c04-a160-01c663d14d34 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:33.770580 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-589cc46f-83a5-4c04-a160-01c663d14d34 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:33.771093 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-589cc46f-83a5-4c04-a160-01c663d14d34 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:33.848571 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-589cc46f-83a5-4c04-a160-01c663d14d34 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:33.857019 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-589cc46f-83a5-4c04-a160-01c663d14d34 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d" status: 200 len: 1245 microversion: 2.1 time: 0.100412 May 23 12:35:33.857599 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 128/263] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:33 2022] GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d => generated 1245 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:34.414073 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-51ddf7ef-ef16-433d-9df8-a95462f48f4f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:34.414775 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-51ddf7ef-ef16-433d-9df8-a95462f48f4f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:34.421537 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-51ddf7ef-ef16-433d-9df8-a95462f48f4f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:34.421987 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-51ddf7ef-ef16-433d-9df8-a95462f48f4f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:34.422767 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-51ddf7ef-ef16-433d-9df8-a95462f48f4f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:34.423206 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-51ddf7ef-ef16-433d-9df8-a95462f48f4f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:34.566187 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-51ddf7ef-ef16-433d-9df8-a95462f48f4f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:34.574426 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-51ddf7ef-ef16-433d-9df8-a95462f48f4f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1523 microversion: 2.1 time: 0.164344 May 23 12:35:34.575013 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 136/264] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:34 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:34.707345 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0d323862-5a6a-48af-8bae-92e7e204b8be tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:34.708021 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-0d323862-5a6a-48af-8bae-92e7e204b8be tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:34.715253 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0d323862-5a6a-48af-8bae-92e7e204b8be tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:34.715949 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0d323862-5a6a-48af-8bae-92e7e204b8be tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:34.716767 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0d323862-5a6a-48af-8bae-92e7e204b8be tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:34.717215 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0d323862-5a6a-48af-8bae-92e7e204b8be tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:34.851498 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0d323862-5a6a-48af-8bae-92e7e204b8be tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:34.859538 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0d323862-5a6a-48af-8bae-92e7e204b8be tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:34.861081 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0d323862-5a6a-48af-8bae-92e7e204b8be tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:34.862248 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-0d323862-5a6a-48af-8bae-92e7e204b8be tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1725 microversion: 2.20 time: 0.159039 May 23 12:35:34.862812 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 129/265] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:35:34 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:35:34.878997 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-0933788c-f9bc-4554-bc81-de015aecb06a tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:34.879689 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-0933788c-f9bc-4554-bc81-de015aecb06a tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: a624bb16-d6b7-491a-9724-9a51af12140d] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:34.886555 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0933788c-f9bc-4554-bc81-de015aecb06a tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:34.887096 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0933788c-f9bc-4554-bc81-de015aecb06a tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:34.887897 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0933788c-f9bc-4554-bc81-de015aecb06a tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:34.888369 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0933788c-f9bc-4554-bc81-de015aecb06a tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:34.950558 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-0933788c-f9bc-4554-bc81-de015aecb06a tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:34.958425 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-0933788c-f9bc-4554-bc81-de015aecb06a tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d" status: 200 len: 1245 microversion: 2.1 time: 0.085039 May 23 12:35:34.959267 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 137/266] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:34 2022] GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:35.590878 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-7d36895a-3767-4632-8342-ed636641dde8 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:35.591492 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-7d36895a-3767-4632-8342-ed636641dde8 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:35.598168 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7d36895a-3767-4632-8342-ed636641dde8 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:35.598687 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7d36895a-3767-4632-8342-ed636641dde8 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:35.599604 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7d36895a-3767-4632-8342-ed636641dde8 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:35.600250 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7d36895a-3767-4632-8342-ed636641dde8 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:35.748516 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-7d36895a-3767-4632-8342-ed636641dde8 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:35.756635 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-7d36895a-3767-4632-8342-ed636641dde8 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1523 microversion: 2.1 time: 0.169625 May 23 12:35:35.757209 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 130/267] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:35 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:35.881859 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-2197dca6-99fd-4e90-8288-c3d086c217cf tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:35.882561 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-2197dca6-99fd-4e90-8288-c3d086c217cf tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:35.889549 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2197dca6-99fd-4e90-8288-c3d086c217cf tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:35.890030 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2197dca6-99fd-4e90-8288-c3d086c217cf tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:35.890926 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2197dca6-99fd-4e90-8288-c3d086c217cf tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:35.891366 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2197dca6-99fd-4e90-8288-c3d086c217cf tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:35.975810 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d4c53e33-90ae-4627-8277-3307fb412f8a tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:35.977454 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d4c53e33-90ae-4627-8277-3307fb412f8a tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: a624bb16-d6b7-491a-9724-9a51af12140d] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:35.984114 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d4c53e33-90ae-4627-8277-3307fb412f8a tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:35.984616 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d4c53e33-90ae-4627-8277-3307fb412f8a tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:35.985585 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d4c53e33-90ae-4627-8277-3307fb412f8a tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:35.986044 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d4c53e33-90ae-4627-8277-3307fb412f8a tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:36.040820 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-2197dca6-99fd-4e90-8288-c3d086c217cf tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:36.048965 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-2197dca6-99fd-4e90-8288-c3d086c217cf tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:36.050591 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-2197dca6-99fd-4e90-8288-c3d086c217cf tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:36.051833 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-2197dca6-99fd-4e90-8288-c3d086c217cf tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1725 microversion: 2.20 time: 0.174161 May 23 12:35:36.052513 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 138/268] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:35:35 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:35:36.063472 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d4c53e33-90ae-4627-8277-3307fb412f8a tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:36.067120 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d4c53e33-90ae-4627-8277-3307fb412f8a tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d" status: 200 len: 1293 microversion: 2.1 time: 0.095133 May 23 12:35:36.067692 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 131/269] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:35 2022] GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d => generated 1293 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:35:36.774673 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-b30f1405-10d9-4e0e-afe2-f0c93003bd00 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:36.775443 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-b30f1405-10d9-4e0e-afe2-f0c93003bd00 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:36.782050 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b30f1405-10d9-4e0e-afe2-f0c93003bd00 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:36.782541 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b30f1405-10d9-4e0e-afe2-f0c93003bd00 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:36.783393 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b30f1405-10d9-4e0e-afe2-f0c93003bd00 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:36.783903 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b30f1405-10d9-4e0e-afe2-f0c93003bd00 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:36.988517 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-b30f1405-10d9-4e0e-afe2-f0c93003bd00 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:36.996569 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-b30f1405-10d9-4e0e-afe2-f0c93003bd00 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1523 microversion: 2.1 time: 0.226924 May 23 12:35:36.997272 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 139/270] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:36 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1523 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:35:37.071143 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-65bd0d5f-2c14-439d-b507-9ec5df28e3c3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:37.071862 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-65bd0d5f-2c14-439d-b507-9ec5df28e3c3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:37.087307 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-010330a9-4f80-41f0-82ef-bb4665ba7792 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:37.087723 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-65bd0d5f-2c14-439d-b507-9ec5df28e3c3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:37.088417 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-010330a9-4f80-41f0-82ef-bb4665ba7792 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: a624bb16-d6b7-491a-9724-9a51af12140d] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:37.088586 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-65bd0d5f-2c14-439d-b507-9ec5df28e3c3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:37.089608 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-65bd0d5f-2c14-439d-b507-9ec5df28e3c3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:37.090326 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-65bd0d5f-2c14-439d-b507-9ec5df28e3c3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:37.098954 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-010330a9-4f80-41f0-82ef-bb4665ba7792 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:37.100049 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-010330a9-4f80-41f0-82ef-bb4665ba7792 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:37.102621 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-010330a9-4f80-41f0-82ef-bb4665ba7792 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:37.103635 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-010330a9-4f80-41f0-82ef-bb4665ba7792 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:37.226199 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-010330a9-4f80-41f0-82ef-bb4665ba7792 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:37.235361 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-010330a9-4f80-41f0-82ef-bb4665ba7792 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d" status: 200 len: 1293 microversion: 2.1 time: 0.154315 May 23 12:35:37.240762 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 140/271] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:37 2022] GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d => generated 1293 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:35:37.294096 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-65bd0d5f-2c14-439d-b507-9ec5df28e3c3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:37.302814 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-65bd0d5f-2c14-439d-b507-9ec5df28e3c3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:37.304976 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-65bd0d5f-2c14-439d-b507-9ec5df28e3c3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:37.306331 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-65bd0d5f-2c14-439d-b507-9ec5df28e3c3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1725 microversion: 2.20 time: 0.239143 May 23 12:35:37.306899 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 132/272] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:35:37 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1725 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:35:38.015137 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-2fc18100-fca5-4081-a0e3-71b39432847a tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:38.015772 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-2fc18100-fca5-4081-a0e3-71b39432847a tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:38.024123 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2fc18100-fca5-4081-a0e3-71b39432847a tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:38.024123 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2fc18100-fca5-4081-a0e3-71b39432847a tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:38.024123 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2fc18100-fca5-4081-a0e3-71b39432847a tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:38.024123 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2fc18100-fca5-4081-a0e3-71b39432847a tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:38.166867 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-2fc18100-fca5-4081-a0e3-71b39432847a tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:38.174726 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-2fc18100-fca5-4081-a0e3-71b39432847a tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1523 microversion: 2.1 time: 0.163503 May 23 12:35:38.175420 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 141/273] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:38 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:38.253162 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-adfa259b-1202-4a0f-9674-2623a7166c4f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:38.253898 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-adfa259b-1202-4a0f-9674-2623a7166c4f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: a624bb16-d6b7-491a-9724-9a51af12140d] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:38.260634 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-adfa259b-1202-4a0f-9674-2623a7166c4f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:38.261083 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-adfa259b-1202-4a0f-9674-2623a7166c4f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:38.261867 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-adfa259b-1202-4a0f-9674-2623a7166c4f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:38.262306 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-adfa259b-1202-4a0f-9674-2623a7166c4f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:38.328317 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-ef376746-f007-439f-853e-dca39dd0ab67 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:38.329364 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-ef376746-f007-439f-853e-dca39dd0ab67 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:38.340357 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ef376746-f007-439f-853e-dca39dd0ab67 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:38.341289 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ef376746-f007-439f-853e-dca39dd0ab67 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:38.342544 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ef376746-f007-439f-853e-dca39dd0ab67 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:38.343266 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ef376746-f007-439f-853e-dca39dd0ab67 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:38.343987 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-adfa259b-1202-4a0f-9674-2623a7166c4f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:38.359893 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-adfa259b-1202-4a0f-9674-2623a7166c4f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d" status: 200 len: 1293 microversion: 2.1 time: 0.110183 May 23 12:35:38.361496 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 133/274] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:38 2022] GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d => generated 1293 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:38.748281 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-ef376746-f007-439f-853e-dca39dd0ab67 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:38.758637 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-ef376746-f007-439f-853e-dca39dd0ab67 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:38.760238 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-ef376746-f007-439f-853e-dca39dd0ab67 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:38.761465 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-ef376746-f007-439f-853e-dca39dd0ab67 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1725 microversion: 2.20 time: 0.439787 May 23 12:35:38.762232 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 142/275] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:35:38 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1725 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:35:39.192211 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f35b3988-ddb3-4bfd-902c-a61dce22b72e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:39.192838 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-f35b3988-ddb3-4bfd-902c-a61dce22b72e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:39.200154 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f35b3988-ddb3-4bfd-902c-a61dce22b72e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:39.201285 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f35b3988-ddb3-4bfd-902c-a61dce22b72e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:39.202082 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f35b3988-ddb3-4bfd-902c-a61dce22b72e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:39.202531 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f35b3988-ddb3-4bfd-902c-a61dce22b72e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:39.219860 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:39.355142 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f35b3988-ddb3-4bfd-902c-a61dce22b72e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:39.363504 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f35b3988-ddb3-4bfd-902c-a61dce22b72e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1523 microversion: 2.1 time: 0.175188 May 23 12:35:39.364087 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 134/276] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:39 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:39.388710 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-cc2a6292-99ad-4fea-843a-6c25df012fcf tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:39.389546 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-cc2a6292-99ad-4fea-843a-6c25df012fcf tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: a624bb16-d6b7-491a-9724-9a51af12140d] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:39.396464 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-cc2a6292-99ad-4fea-843a-6c25df012fcf tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:39.396964 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-cc2a6292-99ad-4fea-843a-6c25df012fcf tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:39.397732 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-cc2a6292-99ad-4fea-843a-6c25df012fcf tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:39.398285 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-cc2a6292-99ad-4fea-843a-6c25df012fcf tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:39.488318 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-cc2a6292-99ad-4fea-843a-6c25df012fcf tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:39.494928 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-cc2a6292-99ad-4fea-843a-6c25df012fcf tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d" status: 200 len: 1293 microversion: 2.1 time: 0.113489 May 23 12:35:39.495674 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 143/277] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:39 2022] GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d => generated 1293 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:39.780725 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-e2d2f87c-39e0-40ef-bc8f-febb09d96868 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:39.781331 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-e2d2f87c-39e0-40ef-bc8f-febb09d96868 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:39.790063 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e2d2f87c-39e0-40ef-bc8f-febb09d96868 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:39.790734 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e2d2f87c-39e0-40ef-bc8f-febb09d96868 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:39.791689 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e2d2f87c-39e0-40ef-bc8f-febb09d96868 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:39.792309 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e2d2f87c-39e0-40ef-bc8f-febb09d96868 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:39.966678 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-e2d2f87c-39e0-40ef-bc8f-febb09d96868 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:39.975533 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-e2d2f87c-39e0-40ef-bc8f-febb09d96868 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:39.978307 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-e2d2f87c-39e0-40ef-bc8f-febb09d96868 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:39.979681 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-e2d2f87c-39e0-40ef-bc8f-febb09d96868 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1725 microversion: 2.20 time: 0.202755 May 23 12:35:39.980407 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 135/278] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:35:39 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1725 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:35:40.381214 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-fb5ff3dc-481a-47c1-8284-a12d07d6c0f3 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:40.381820 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-fb5ff3dc-481a-47c1-8284-a12d07d6c0f3 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:40.383920 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=1 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:40.389264 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-fb5ff3dc-481a-47c1-8284-a12d07d6c0f3 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:40.389860 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-fb5ff3dc-481a-47c1-8284-a12d07d6c0f3 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:40.390459 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-fb5ff3dc-481a-47c1-8284-a12d07d6c0f3 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:40.390903 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-fb5ff3dc-481a-47c1-8284-a12d07d6c0f3 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:40.512424 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-091ccebc-67c5-46fb-aaad-3708fbd2583c tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:40.513253 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-091ccebc-67c5-46fb-aaad-3708fbd2583c tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: a624bb16-d6b7-491a-9724-9a51af12140d] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:40.520225 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-091ccebc-67c5-46fb-aaad-3708fbd2583c tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:40.520679 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-091ccebc-67c5-46fb-aaad-3708fbd2583c tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:40.521467 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-091ccebc-67c5-46fb-aaad-3708fbd2583c tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:40.521915 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-091ccebc-67c5-46fb-aaad-3708fbd2583c tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:40.534278 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-fb5ff3dc-481a-47c1-8284-a12d07d6c0f3 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:40.545750 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-fb5ff3dc-481a-47c1-8284-a12d07d6c0f3 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1523 microversion: 2.1 time: 0.168297 May 23 12:35:40.546792 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 144/279] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:40 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:35:40.592901 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-091ccebc-67c5-46fb-aaad-3708fbd2583c tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:40.595812 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-091ccebc-67c5-46fb-aaad-3708fbd2583c tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d" status: 200 len: 1293 microversion: 2.1 time: 0.088074 May 23 12:35:40.596427 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 136/280] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:40 2022] GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d => generated 1293 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:35:40.998561 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-b1057030-3736-409c-a0fa-6d3ac25d4819 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:40.999286 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-b1057030-3736-409c-a0fa-6d3ac25d4819 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:41.005261 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b1057030-3736-409c-a0fa-6d3ac25d4819 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:41.005710 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b1057030-3736-409c-a0fa-6d3ac25d4819 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:41.006487 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b1057030-3736-409c-a0fa-6d3ac25d4819 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:41.006924 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b1057030-3736-409c-a0fa-6d3ac25d4819 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:41.151903 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-b1057030-3736-409c-a0fa-6d3ac25d4819 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:41.160799 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-b1057030-3736-409c-a0fa-6d3ac25d4819 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:41.162647 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-b1057030-3736-409c-a0fa-6d3ac25d4819 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:41.163848 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-b1057030-3736-409c-a0fa-6d3ac25d4819 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1725 microversion: 2.20 time: 0.169302 May 23 12:35:41.164441 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 145/281] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:35:40 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:35:41.563634 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-1bf106d7-0dcc-4489-9783-f033b7f9475c tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:41.564981 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-1bf106d7-0dcc-4489-9783-f033b7f9475c tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:41.572094 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1bf106d7-0dcc-4489-9783-f033b7f9475c tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:41.572575 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1bf106d7-0dcc-4489-9783-f033b7f9475c tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:41.573357 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1bf106d7-0dcc-4489-9783-f033b7f9475c tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:41.573795 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1bf106d7-0dcc-4489-9783-f033b7f9475c tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:41.613214 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-1e44082b-4392-4956-903b-a66a9e26c2aa tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:41.614504 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-1e44082b-4392-4956-903b-a66a9e26c2aa tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: a624bb16-d6b7-491a-9724-9a51af12140d] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:41.623513 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1e44082b-4392-4956-903b-a66a9e26c2aa tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:41.624142 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1e44082b-4392-4956-903b-a66a9e26c2aa tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:41.625074 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1e44082b-4392-4956-903b-a66a9e26c2aa tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:41.625689 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1e44082b-4392-4956-903b-a66a9e26c2aa tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:41.701596 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-1e44082b-4392-4956-903b-a66a9e26c2aa tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:41.712248 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-1e44082b-4392-4956-903b-a66a9e26c2aa tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d" status: 200 len: 1293 microversion: 2.1 time: 0.102759 May 23 12:35:41.712864 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 146/282] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:41 2022] GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d => generated 1293 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:35:41.779870 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1bf106d7-0dcc-4489-9783-f033b7f9475c tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:41.788141 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-1bf106d7-0dcc-4489-9783-f033b7f9475c tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1523 microversion: 2.1 time: 0.228601 May 23 12:35:41.791664 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 137/283] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:41 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1523 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:42.182596 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-a4da418a-2592-4bda-a7d6-fd6f6547479c tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:42.183204 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-a4da418a-2592-4bda-a7d6-fd6f6547479c tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:42.189239 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a4da418a-2592-4bda-a7d6-fd6f6547479c tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:42.189689 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a4da418a-2592-4bda-a7d6-fd6f6547479c tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:42.191254 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a4da418a-2592-4bda-a7d6-fd6f6547479c tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:42.191254 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a4da418a-2592-4bda-a7d6-fd6f6547479c tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:42.206062 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell1:SELECT=100 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:42.329542 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-a4da418a-2592-4bda-a7d6-fd6f6547479c tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:42.338200 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-a4da418a-2592-4bda-a7d6-fd6f6547479c tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:42.339799 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-a4da418a-2592-4bda-a7d6-fd6f6547479c tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:42.341071 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-a4da418a-2592-4bda-a7d6-fd6f6547479c tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1725 microversion: 2.20 time: 0.163034 May 23 12:35:42.341706 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 147/284] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:35:42 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:35:42.730139 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-31f21411-eb9a-436a-b741-781278406723 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:42.730991 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-31f21411-eb9a-436a-b741-781278406723 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: a624bb16-d6b7-491a-9724-9a51af12140d] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:42.733473 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell0:SELECT=2 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:42.734305 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell0:SELECT=6 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:42.744603 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-31f21411-eb9a-436a-b741-781278406723 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:42.745141 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-31f21411-eb9a-436a-b741-781278406723 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:42.746114 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-31f21411-eb9a-436a-b741-781278406723 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:42.746843 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-31f21411-eb9a-436a-b741-781278406723 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:42.806176 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-f16dc7a3-c485-4b7a-aa8c-16a3d04e36ac tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:42.806792 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-f16dc7a3-c485-4b7a-aa8c-16a3d04e36ac tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:42.809528 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell0:SELECT=6 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:42.819311 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-31f21411-eb9a-436a-b741-781278406723 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:42.828672 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f16dc7a3-c485-4b7a-aa8c-16a3d04e36ac tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:42.829125 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f16dc7a3-c485-4b7a-aa8c-16a3d04e36ac tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:42.829908 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f16dc7a3-c485-4b7a-aa8c-16a3d04e36ac tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:42.830342 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f16dc7a3-c485-4b7a-aa8c-16a3d04e36ac tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:42.830701 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-31f21411-eb9a-436a-b741-781278406723 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d" status: 200 len: 1293 microversion: 2.1 time: 0.105297 May 23 12:35:42.831349 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 138/285] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:42 2022] GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d => generated 1293 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:42.973541 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-f16dc7a3-c485-4b7a-aa8c-16a3d04e36ac tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:42.984261 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-f16dc7a3-c485-4b7a-aa8c-16a3d04e36ac tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1523 microversion: 2.1 time: 0.182064 May 23 12:35:42.984841 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 148/286] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:42 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:43.361269 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f317b557-46a5-4cfc-8d72-9b8ce0fea399 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:43.362330 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-f317b557-46a5-4cfc-8d72-9b8ce0fea399 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:43.369392 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f317b557-46a5-4cfc-8d72-9b8ce0fea399 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:43.370102 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f317b557-46a5-4cfc-8d72-9b8ce0fea399 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:43.370878 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f317b557-46a5-4cfc-8d72-9b8ce0fea399 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:43.371311 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f317b557-46a5-4cfc-8d72-9b8ce0fea399 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:43.510875 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f317b557-46a5-4cfc-8d72-9b8ce0fea399 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:43.521396 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f317b557-46a5-4cfc-8d72-9b8ce0fea399 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:43.523647 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f317b557-46a5-4cfc-8d72-9b8ce0fea399 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:43.525381 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f317b557-46a5-4cfc-8d72-9b8ce0fea399 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1725 microversion: 2.20 time: 0.168190 May 23 12:35:43.526025 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 139/287] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:35:43 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:35:43.848584 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-1a963cce-a49a-46c3-9dca-25312707a039 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:43.849289 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-1a963cce-a49a-46c3-9dca-25312707a039 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: a624bb16-d6b7-491a-9724-9a51af12140d] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:43.860664 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1a963cce-a49a-46c3-9dca-25312707a039 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:43.861764 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1a963cce-a49a-46c3-9dca-25312707a039 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:43.862796 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1a963cce-a49a-46c3-9dca-25312707a039 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:43.863412 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1a963cce-a49a-46c3-9dca-25312707a039 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:43.961237 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-1a963cce-a49a-46c3-9dca-25312707a039 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:43.973754 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-1a963cce-a49a-46c3-9dca-25312707a039 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d" status: 200 len: 1293 microversion: 2.1 time: 0.128993 May 23 12:35:43.974327 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 149/288] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:43 2022] GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d => generated 1293 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:44.010558 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0e0002a4-3424-422e-b0d0-698d9b2e5623 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:44.011799 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-0e0002a4-3424-422e-b0d0-698d9b2e5623 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:44.021526 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0e0002a4-3424-422e-b0d0-698d9b2e5623 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:44.021982 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0e0002a4-3424-422e-b0d0-698d9b2e5623 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:44.022927 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0e0002a4-3424-422e-b0d0-698d9b2e5623 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:44.023443 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0e0002a4-3424-422e-b0d0-698d9b2e5623 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:44.227288 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0e0002a4-3424-422e-b0d0-698d9b2e5623 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:44.236393 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-0e0002a4-3424-422e-b0d0-698d9b2e5623 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1523 microversion: 2.1 time: 0.238531 May 23 12:35:44.246916 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 140/289] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:43 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1523 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:44.543426 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-be517abf-5f62-4930-893e-389972115af7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:44.544396 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-be517abf-5f62-4930-893e-389972115af7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:44.556071 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-be517abf-5f62-4930-893e-389972115af7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:44.556875 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-be517abf-5f62-4930-893e-389972115af7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:44.557861 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-be517abf-5f62-4930-893e-389972115af7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:44.558508 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-be517abf-5f62-4930-893e-389972115af7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:44.719728 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-be517abf-5f62-4930-893e-389972115af7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:44.731505 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-be517abf-5f62-4930-893e-389972115af7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:44.734299 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-be517abf-5f62-4930-893e-389972115af7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:44.735503 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-be517abf-5f62-4930-893e-389972115af7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1725 microversion: 2.20 time: 0.195933 May 23 12:35:44.736453 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 150/290] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:35:44 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1725 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:35:44.993168 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-ac9cf4bc-801d-43ce-b3a7-0150d715b5b8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:44.993841 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-ac9cf4bc-801d-43ce-b3a7-0150d715b5b8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: a624bb16-d6b7-491a-9724-9a51af12140d] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:45.002687 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ac9cf4bc-801d-43ce-b3a7-0150d715b5b8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:45.003144 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ac9cf4bc-801d-43ce-b3a7-0150d715b5b8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:45.003925 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ac9cf4bc-801d-43ce-b3a7-0150d715b5b8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:45.004390 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ac9cf4bc-801d-43ce-b3a7-0150d715b5b8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:45.148586 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-ac9cf4bc-801d-43ce-b3a7-0150d715b5b8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:45.167200 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-ac9cf4bc-801d-43ce-b3a7-0150d715b5b8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d" status: 200 len: 1293 microversion: 2.1 time: 0.179697 May 23 12:35:45.167836 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 141/291] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:44 2022] GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d => generated 1293 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:45.255558 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-3fd82939-8b89-43d9-927a-5b6bf8760845 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:45.256894 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-3fd82939-8b89-43d9-927a-5b6bf8760845 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:45.271871 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3fd82939-8b89-43d9-927a-5b6bf8760845 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:45.272436 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3fd82939-8b89-43d9-927a-5b6bf8760845 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:45.273515 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3fd82939-8b89-43d9-927a-5b6bf8760845 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:45.274183 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3fd82939-8b89-43d9-927a-5b6bf8760845 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:45.450674 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-3fd82939-8b89-43d9-927a-5b6bf8760845 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:45.461250 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-3fd82939-8b89-43d9-927a-5b6bf8760845 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1523 microversion: 2.1 time: 0.210877 May 23 12:35:45.462229 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 151/292] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:45 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1523 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:45.754223 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c78cf395-23cf-4861-a3c9-3c5b15d560db tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:45.754835 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c78cf395-23cf-4861-a3c9-3c5b15d560db tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:45.761473 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c78cf395-23cf-4861-a3c9-3c5b15d560db tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:45.761925 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c78cf395-23cf-4861-a3c9-3c5b15d560db tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:45.763470 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c78cf395-23cf-4861-a3c9-3c5b15d560db tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:45.763966 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c78cf395-23cf-4861-a3c9-3c5b15d560db tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:45.906508 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c78cf395-23cf-4861-a3c9-3c5b15d560db tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:45.916022 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c78cf395-23cf-4861-a3c9-3c5b15d560db tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:45.918425 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c78cf395-23cf-4861-a3c9-3c5b15d560db tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:45.919893 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c78cf395-23cf-4861-a3c9-3c5b15d560db tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1725 microversion: 2.20 time: 0.169570 May 23 12:35:45.920553 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 142/293] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:35:45 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:35:46.184006 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-c9dd94c5-8441-4bd5-83d8-b69c2a54525b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:46.184881 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-c9dd94c5-8441-4bd5-83d8-b69c2a54525b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: a624bb16-d6b7-491a-9724-9a51af12140d] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:46.194447 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c9dd94c5-8441-4bd5-83d8-b69c2a54525b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:46.194985 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c9dd94c5-8441-4bd5-83d8-b69c2a54525b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:46.198151 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c9dd94c5-8441-4bd5-83d8-b69c2a54525b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:46.198704 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c9dd94c5-8441-4bd5-83d8-b69c2a54525b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:46.293833 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-c9dd94c5-8441-4bd5-83d8-b69c2a54525b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:46.302284 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-c9dd94c5-8441-4bd5-83d8-b69c2a54525b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d" status: 200 len: 1293 microversion: 2.1 time: 0.121954 May 23 12:35:46.303575 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 152/294] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:46 2022] GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d => generated 1293 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:46.484023 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-a5f0eb1c-7508-45f5-8cc1-1cab42aeaf04 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:46.484991 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-a5f0eb1c-7508-45f5-8cc1-1cab42aeaf04 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:46.498750 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a5f0eb1c-7508-45f5-8cc1-1cab42aeaf04 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:46.504525 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a5f0eb1c-7508-45f5-8cc1-1cab42aeaf04 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:46.509624 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a5f0eb1c-7508-45f5-8cc1-1cab42aeaf04 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:46.510390 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a5f0eb1c-7508-45f5-8cc1-1cab42aeaf04 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:46.770925 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-a5f0eb1c-7508-45f5-8cc1-1cab42aeaf04 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:46.783799 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-a5f0eb1c-7508-45f5-8cc1-1cab42aeaf04 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1523 microversion: 2.1 time: 0.303456 May 23 12:35:46.785003 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 143/295] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:46 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1523 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:46.939359 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-86eadfc9-77b0-4e05-8bf0-b18ee769edc0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:46.939969 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-86eadfc9-77b0-4e05-8bf0-b18ee769edc0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:46.950018 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-86eadfc9-77b0-4e05-8bf0-b18ee769edc0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:46.950473 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-86eadfc9-77b0-4e05-8bf0-b18ee769edc0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:46.951888 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-86eadfc9-77b0-4e05-8bf0-b18ee769edc0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:46.952400 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-86eadfc9-77b0-4e05-8bf0-b18ee769edc0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:47.285730 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-86eadfc9-77b0-4e05-8bf0-b18ee769edc0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:47.295775 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-86eadfc9-77b0-4e05-8bf0-b18ee769edc0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:47.299052 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-86eadfc9-77b0-4e05-8bf0-b18ee769edc0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:47.301291 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-86eadfc9-77b0-4e05-8bf0-b18ee769edc0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1746 microversion: 2.20 time: 0.366240 May 23 12:35:47.302420 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 153/296] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:35:46 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1746 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:35:47.321693 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0e6e7270-a575-4fed-8c19-dc2ab1eb1e4f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:47.322566 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-0e6e7270-a575-4fed-8c19-dc2ab1eb1e4f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: a624bb16-d6b7-491a-9724-9a51af12140d] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:47.330594 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0e6e7270-a575-4fed-8c19-dc2ab1eb1e4f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:47.331041 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0e6e7270-a575-4fed-8c19-dc2ab1eb1e4f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:47.331818 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0e6e7270-a575-4fed-8c19-dc2ab1eb1e4f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:47.332281 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0e6e7270-a575-4fed-8c19-dc2ab1eb1e4f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:47.408046 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0e6e7270-a575-4fed-8c19-dc2ab1eb1e4f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:47.416602 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-0e6e7270-a575-4fed-8c19-dc2ab1eb1e4f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d" status: 200 len: 1311 microversion: 2.1 time: 0.099770 May 23 12:35:47.417545 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 144/297] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:47 2022] GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d => generated 1311 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:47.801529 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-7ba4145e-eb7b-427b-87b4-de5815eac83e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:47.802144 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-7ba4145e-eb7b-427b-87b4-de5815eac83e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:47.822445 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7ba4145e-eb7b-427b-87b4-de5815eac83e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:47.822905 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7ba4145e-eb7b-427b-87b4-de5815eac83e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:47.823923 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7ba4145e-eb7b-427b-87b4-de5815eac83e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:47.824623 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7ba4145e-eb7b-427b-87b4-de5815eac83e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:48.109406 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-7ba4145e-eb7b-427b-87b4-de5815eac83e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:48.121528 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-7ba4145e-eb7b-427b-87b4-de5815eac83e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1523 microversion: 2.1 time: 0.324114 May 23 12:35:48.122105 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 154/298] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:47 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1523 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:48.232482 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-5b093e02-d144-4030-a2f1-0cf8f06f4fec tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:35:48.243248 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5b093e02-d144-4030-a2f1-0cf8f06f4fec tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:48.246050 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5b093e02-d144-4030-a2f1-0cf8f06f4fec tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:48.321389 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-379b1fbe-8c0e-465f-b39b-a216904cff54 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:48.322018 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-379b1fbe-8c0e-465f-b39b-a216904cff54 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:48.338875 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-379b1fbe-8c0e-465f-b39b-a216904cff54 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:48.339332 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-379b1fbe-8c0e-465f-b39b-a216904cff54 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:48.340128 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-379b1fbe-8c0e-465f-b39b-a216904cff54 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:48.340598 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-379b1fbe-8c0e-465f-b39b-a216904cff54 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:48.347825 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-5b093e02-d144-4030-a2f1-0cf8f06f4fec tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Going to try to stop instance {{(pid=124199) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 23 12:35:48.473847 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-5b093e02-d144-4030-a2f1-0cf8f06f4fec tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "POST /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e/action" status: 202 len: 0 microversion: 2.1 time: 0.247405 May 23 12:35:48.474510 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 145/299] 10.222.0.16 () {60 vars in 1277 bytes} [Mon May 23 12:35:48 2022] POST /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:35:48.491729 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-62b88ea4-4734-4b0a-b1a5-efbdd123a074 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:48.492565 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-62b88ea4-4734-4b0a-b1a5-efbdd123a074 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: a624bb16-d6b7-491a-9724-9a51af12140d] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:48.504879 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-62b88ea4-4734-4b0a-b1a5-efbdd123a074 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:48.515962 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-62b88ea4-4734-4b0a-b1a5-efbdd123a074 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:48.516933 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-62b88ea4-4734-4b0a-b1a5-efbdd123a074 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:48.521396 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-62b88ea4-4734-4b0a-b1a5-efbdd123a074 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:49.010308 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-62b88ea4-4734-4b0a-b1a5-efbdd123a074 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:49.012364 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-379b1fbe-8c0e-465f-b39b-a216904cff54 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:49.027563 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-379b1fbe-8c0e-465f-b39b-a216904cff54 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:49.029383 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-379b1fbe-8c0e-465f-b39b-a216904cff54 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:49.031684 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-379b1fbe-8c0e-465f-b39b-a216904cff54 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1746 microversion: 2.20 time: 0.714779 May 23 12:35:49.032800 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-62b88ea4-4734-4b0a-b1a5-efbdd123a074 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d" status: 200 len: 1367 microversion: 2.1 time: 0.554287 May 23 12:35:49.034224 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 146/300] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:48 2022] GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d => generated 1367 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:49.044825 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 155/301] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:35:48 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1746 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:35:49.045678 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-ae8a950d-bba5-4888-91a0-bfedce2d60bd tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:49.046717 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-ae8a950d-bba5-4888-91a0-bfedce2d60bd tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:49.065982 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ae8a950d-bba5-4888-91a0-bfedce2d60bd tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:49.067292 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ae8a950d-bba5-4888-91a0-bfedce2d60bd tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:49.069096 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ae8a950d-bba5-4888-91a0-bfedce2d60bd tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:49.072606 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ae8a950d-bba5-4888-91a0-bfedce2d60bd tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:49.139594 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-ad6b07a6-eca5-47cb-bb77-03ecd0ec84d2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:49.140365 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-ad6b07a6-eca5-47cb-bb77-03ecd0ec84d2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:49.147959 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ad6b07a6-eca5-47cb-bb77-03ecd0ec84d2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:49.151649 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ad6b07a6-eca5-47cb-bb77-03ecd0ec84d2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:49.154800 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ad6b07a6-eca5-47cb-bb77-03ecd0ec84d2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:49.155687 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ad6b07a6-eca5-47cb-bb77-03ecd0ec84d2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:49.573718 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-ae8a950d-bba5-4888-91a0-bfedce2d60bd tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:49.587577 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-ae8a950d-bba5-4888-91a0-bfedce2d60bd tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 200 len: 1722 microversion: 2.1 time: 0.549117 May 23 12:35:49.588807 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 147/302] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:49 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 1722 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:49.614437 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-ad6b07a6-eca5-47cb-bb77-03ecd0ec84d2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:49.631211 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-ad6b07a6-eca5-47cb-bb77-03ecd0ec84d2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1523 microversion: 2.1 time: 0.495370 May 23 12:35:49.632975 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 156/303] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:49 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1523 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:35:50.051893 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-024ec9c3-7424-475e-8b26-c316fa239377 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:50.052515 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-024ec9c3-7424-475e-8b26-c316fa239377 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: a624bb16-d6b7-491a-9724-9a51af12140d] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:50.065027 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-de4c2997-27b0-4cf7-b56e-c62ee760f54a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:50.065649 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-de4c2997-27b0-4cf7-b56e-c62ee760f54a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:50.074454 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-de4c2997-27b0-4cf7-b56e-c62ee760f54a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:50.074850 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-de4c2997-27b0-4cf7-b56e-c62ee760f54a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:50.075641 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-de4c2997-27b0-4cf7-b56e-c62ee760f54a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:50.076085 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-de4c2997-27b0-4cf7-b56e-c62ee760f54a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:50.082162 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-024ec9c3-7424-475e-8b26-c316fa239377 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:50.082680 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-024ec9c3-7424-475e-8b26-c316fa239377 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:50.089445 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-024ec9c3-7424-475e-8b26-c316fa239377 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:50.090139 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-024ec9c3-7424-475e-8b26-c316fa239377 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:50.473021 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-de4c2997-27b0-4cf7-b56e-c62ee760f54a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:50.479602 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-024ec9c3-7424-475e-8b26-c316fa239377 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:50.486243 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-de4c2997-27b0-4cf7-b56e-c62ee760f54a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:50.489289 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-024ec9c3-7424-475e-8b26-c316fa239377 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d" status: 200 len: 1367 microversion: 2.1 time: 0.441876 May 23 12:35:50.491534 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-de4c2997-27b0-4cf7-b56e-c62ee760f54a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:50.491534 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-de4c2997-27b0-4cf7-b56e-c62ee760f54a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1746 microversion: 2.20 time: 0.430043 May 23 12:35:50.493218 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 157/304] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:35:50 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1746 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:35:50.509869 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 148/305] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:50 2022] GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d => generated 1367 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:50.569910 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-ecb3104b-b900-417e-9315-a4a1d61bd287 req-feb40cf6-616c-4679-aa49-13d736de1d92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a624bb16-d6b7-491a-9724-9a51af12140d", "tag": "214009e0-0102-49c7-bbc1-24d5fb2d2f55"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:35:50.608233 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b905f3ff-2d70-4783-8512-795c04f5188e tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:50.608969 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-b905f3ff-2d70-4783-8512-795c04f5188e tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:50.610907 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-ecb3104b-b900-417e-9315-a4a1d61bd287 req-feb40cf6-616c-4679-aa49-13d736de1d92 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:50.611582 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-ecb3104b-b900-417e-9315-a4a1d61bd287 req-feb40cf6-616c-4679-aa49-13d736de1d92 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:50.620343 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b905f3ff-2d70-4783-8512-795c04f5188e tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:50.621074 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b905f3ff-2d70-4783-8512-795c04f5188e tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:50.623363 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b905f3ff-2d70-4783-8512-795c04f5188e tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:50.624033 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b905f3ff-2d70-4783-8512-795c04f5188e tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:50.635105 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-ecb3104b-b900-417e-9315-a4a1d61bd287 req-feb40cf6-616c-4679-aa49-13d736de1d92 service nova] Creating event network-changed:214009e0-0102-49c7-bbc1-24d5fb2d2f55 for instance a624bb16-d6b7-491a-9724-9a51af12140d on hv-cinder-83699 May 23 12:35:50.642734 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-ecb3104b-b900-417e-9315-a4a1d61bd287 req-feb40cf6-616c-4679-aa49-13d736de1d92 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077653 May 23 12:35:50.648873 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 158/306] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:35:50.670691 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-4e97cf77-dfe3-4b91-a198-461a923205aa tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:50.671986 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-4e97cf77-dfe3-4b91-a198-461a923205aa tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:50.690234 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4e97cf77-dfe3-4b91-a198-461a923205aa tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:50.690766 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4e97cf77-dfe3-4b91-a198-461a923205aa tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:50.691568 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4e97cf77-dfe3-4b91-a198-461a923205aa tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:50.692427 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4e97cf77-dfe3-4b91-a198-461a923205aa tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:50.973064 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b905f3ff-2d70-4783-8512-795c04f5188e tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:50.990005 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b905f3ff-2d70-4783-8512-795c04f5188e tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 200 len: 1722 microversion: 2.1 time: 0.383568 May 23 12:35:50.990659 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 149/307] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:50 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 1722 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:51.001005 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-4e97cf77-dfe3-4b91-a198-461a923205aa tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:51.012974 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-4e97cf77-dfe3-4b91-a198-461a923205aa tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1523 microversion: 2.1 time: 0.362501 May 23 12:35:51.013569 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 159/308] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:50 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1523 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:51.510714 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-63dfba40-de5c-4ac6-9446-c2b2f3f47262 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:51.511623 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-63dfba40-de5c-4ac6-9446-c2b2f3f47262 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:51.517580 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-ae7be9d9-9e78-4718-8a37-1f548b23757e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:51.518231 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-ae7be9d9-9e78-4718-8a37-1f548b23757e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: a624bb16-d6b7-491a-9724-9a51af12140d] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:51.527298 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-63dfba40-de5c-4ac6-9446-c2b2f3f47262 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:51.528801 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-63dfba40-de5c-4ac6-9446-c2b2f3f47262 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:51.534557 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-63dfba40-de5c-4ac6-9446-c2b2f3f47262 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:51.535809 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ae7be9d9-9e78-4718-8a37-1f548b23757e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:51.536127 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-63dfba40-de5c-4ac6-9446-c2b2f3f47262 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:51.536654 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ae7be9d9-9e78-4718-8a37-1f548b23757e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:51.537726 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ae7be9d9-9e78-4718-8a37-1f548b23757e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:51.538228 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ae7be9d9-9e78-4718-8a37-1f548b23757e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:51.540472 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:51.945797 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-ae7be9d9-9e78-4718-8a37-1f548b23757e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:51.963477 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-ae7be9d9-9e78-4718-8a37-1f548b23757e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d" status: 200 len: 1367 microversion: 2.1 time: 0.449820 May 23 12:35:51.998921 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 160/309] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:51 2022] GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d => generated 1367 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:35:52.015917 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-d3a651e4-80e2-4d47-a843-b118f4e41341 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:52.016585 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-d3a651e4-80e2-4d47-a843-b118f4e41341 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:52.037941 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-63dfba40-de5c-4ac6-9446-c2b2f3f47262 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:52.050254 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d3a651e4-80e2-4d47-a843-b118f4e41341 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:52.052222 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d3a651e4-80e2-4d47-a843-b118f4e41341 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:52.053062 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d3a651e4-80e2-4d47-a843-b118f4e41341 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:52.053506 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d3a651e4-80e2-4d47-a843-b118f4e41341 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:52.057384 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-63dfba40-de5c-4ac6-9446-c2b2f3f47262 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:52.059014 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-63dfba40-de5c-4ac6-9446-c2b2f3f47262 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:52.060303 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-63dfba40-de5c-4ac6-9446-c2b2f3f47262 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1746 microversion: 2.20 time: 0.553558 May 23 12:35:52.060872 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 150/310] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:35:51 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1746 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:35:52.077936 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-164e8c6e-c82e-4100-8684-068ae2f00982 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:52.078563 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-164e8c6e-c82e-4100-8684-068ae2f00982 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:52.099923 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-164e8c6e-c82e-4100-8684-068ae2f00982 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:52.100412 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-164e8c6e-c82e-4100-8684-068ae2f00982 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:52.101751 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-164e8c6e-c82e-4100-8684-068ae2f00982 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:52.102187 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-164e8c6e-c82e-4100-8684-068ae2f00982 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:53.136883 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-164e8c6e-c82e-4100-8684-068ae2f00982 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:53.151516 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-164e8c6e-c82e-4100-8684-068ae2f00982 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1503 microversion: 2.1 time: 1.085015 May 23 12:35:53.152702 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 151/311] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:52 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1503 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:53.170077 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-a130bbb5-221c-4438-82b8-7877b046313d req-135788fc-d1ad-477d-aa0d-fd6e28fd31d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce37af9c-e5f8-4233-97f3-4280a2114e45", "name": "network-vif-plugged", "status": "completed", "tag": "357ce430-3b90-4a7c-b2f3-c2ee303501e4"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:35:53.188431 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-d3a651e4-80e2-4d47-a843-b118f4e41341 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:53.194578 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-a130bbb5-221c-4438-82b8-7877b046313d req-135788fc-d1ad-477d-aa0d-fd6e28fd31d5 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:53.195974 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-a130bbb5-221c-4438-82b8-7877b046313d req-135788fc-d1ad-477d-aa0d-fd6e28fd31d5 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:53.226216 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-d3a651e4-80e2-4d47-a843-b118f4e41341 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 200 len: 1722 microversion: 2.1 time: 1.212370 May 23 12:35:53.227071 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-a130bbb5-221c-4438-82b8-7877b046313d req-135788fc-d1ad-477d-aa0d-fd6e28fd31d5 service nova] Creating event network-vif-plugged:357ce430-3b90-4a7c-b2f3-c2ee303501e4 for instance ce37af9c-e5f8-4233-97f3-4280a2114e45 on hv-cinder-83699 May 23 12:35:53.231695 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 161/312] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:52 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 1722 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:53.238490 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-a130bbb5-221c-4438-82b8-7877b046313d req-135788fc-d1ad-477d-aa0d-fd6e28fd31d5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084351 May 23 12:35:53.240849 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 152/313] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:35:53.248700 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-fea056e6-3674-4145-bce7-b284183134b6 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:53.252618 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-e05539ad-3fc8-4499-ad44-d82f599c3a2d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:53.253337 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-e05539ad-3fc8-4499-ad44-d82f599c3a2d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:53.258749 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-fea056e6-3674-4145-bce7-b284183134b6 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: a624bb16-d6b7-491a-9724-9a51af12140d] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:53.270714 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e05539ad-3fc8-4499-ad44-d82f599c3a2d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:53.271172 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e05539ad-3fc8-4499-ad44-d82f599c3a2d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:53.275949 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e05539ad-3fc8-4499-ad44-d82f599c3a2d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:53.279266 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e05539ad-3fc8-4499-ad44-d82f599c3a2d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:53.296149 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-fea056e6-3674-4145-bce7-b284183134b6 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:53.299200 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-fea056e6-3674-4145-bce7-b284183134b6 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:53.300562 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-fea056e6-3674-4145-bce7-b284183134b6 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:53.305898 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-fea056e6-3674-4145-bce7-b284183134b6 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:53.869098 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-e05539ad-3fc8-4499-ad44-d82f599c3a2d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:53.886321 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-e05539ad-3fc8-4499-ad44-d82f599c3a2d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:53.895420 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-e05539ad-3fc8-4499-ad44-d82f599c3a2d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:53.897288 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-fea056e6-3674-4145-bce7-b284183134b6 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:53.898625 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-e05539ad-3fc8-4499-ad44-d82f599c3a2d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1741 microversion: 2.20 time: 0.655704 May 23 12:35:53.899288 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 153/314] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:35:53 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1741 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:35:53.911094 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-fea056e6-3674-4145-bce7-b284183134b6 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d" status: 200 len: 1367 microversion: 2.1 time: 0.675530 May 23 12:35:53.921770 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-39b43e30-f717-4952-aac2-df28c8a1ae8c tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6301feb8-7b7c-43b9-821b-030487a6d577"}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:35:53.923723 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-39b43e30-f717-4952-aac2-df28c8a1ae8c tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:53.928811 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 162/315] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:53 2022] GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d => generated 1367 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:53.933856 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-39b43e30-f717-4952-aac2-df28c8a1ae8c tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:53.935977 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-39b43e30-f717-4952-aac2-df28c8a1ae8c tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:53.936998 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-39b43e30-f717-4952-aac2-df28c8a1ae8c tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:53.938976 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-39b43e30-f717-4952-aac2-df28c8a1ae8c tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:54.014071 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.wsgi [None req-39b43e30-f717-4952-aac2-df28c8a1ae8c tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] HTTP exception thrown: Cannot 'attach_volume' instance 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa while it is in vm_state rescued May 23 12:35:54.020559 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-39b43e30-f717-4952-aac2-df28c8a1ae8c tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Request method failure captured: May 23 12:35:54.020559 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: request: POST /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa/os-volume_attachments HTTP/1.1 May 23 12:35:54.020559 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept: application/json May 23 12:35:54.020559 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept-Encoding: identity May 23 12:35:54.020559 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Connection: close May 23 12:35:54.020559 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Length: 74 May 23 12:35:54.020559 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Type: application/json May 23 12:35:54.020559 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Host: 10.222.0.16 May 23 12:35:54.020559 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Openstack-System-Scope: None May 23 12:35:54.020559 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: User-Agent: python-urllib3/1.26.9 May 23 12:35:54.020559 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Auth-Token: gAAAAABii38iJaeoogG5HQkTeh9nj0rGOP9VyOFedVQ4rI22IsjBVAneC4_uWbO22G3kbdcZRA9jPU4ejUnxmNU5jfy_2y_etQMmPY5AMnbyQR_IV7orew0xRV9LzMqa87mHc9D9zuVTwg73oa7Mf_pjol8tTgwzZ3VnGtE-MhQByJ8OewzppZw May 23 12:35:54.020559 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Id: None May 23 12:35:54.020559 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Name: None May 23 12:35:54.020559 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Identity-Status: Confirmed May 23 12:35:54.020559 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Is-Admin-Project: True May 23 12:35:54.020559 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Id: default May 23 12:35:54.020559 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Name: Default May 23 12:35:54.020559 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Id: dcc45b8bab17498cadda8d64b3a76780 May 23 12:35:54.020559 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1322715344 May 23 12:35:54.020559 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Role: member,reader May 23 12:35:54.020559 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Roles: member,reader May 23 12:35:54.021955 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dcc45b8bab17498cadda8d64b3a76780"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dcc45b8bab17498cadda8d64b3a76780"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dcc45b8bab17498cadda8d64b3a76780", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dcc45b8bab17498cadda8d64b3a76780"}]}] May 23 12:35:54.021955 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1322715344 May 23 12:35:54.021955 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Id: dcc45b8bab17498cadda8d64b3a76780 May 23 12:35:54.021955 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1322715344 May 23 12:35:54.021955 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User: tempest-ServerRescueNegativeTestJSON-1322715344-project May 23 12:35:54.021955 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Id: default May 23 12:35:54.021955 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Name: Default May 23 12:35:54.021955 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Id: 687208d733174bffa2783e6857401f39 May 23 12:35:54.021955 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1322715344-project May 23 12:35:54.021955 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: May 23 12:35:54.021955 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: {"volumeAttachment": {"volumeId": "6301feb8-7b7c-43b9-821b-030487a6d577"}} May 23 12:35:54.021955 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: method: > May 23 12:35:54.023112 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: exception: Cannot 'attach_volume' instance 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa while it is in vm_state rescued May 23 12:35:54.023112 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: action_args: {'server_id': '9cdb78f1-4de7-4c61-82e0-abe6c742e7aa', 'body': {'volumeAttachment': {'volumeId': '6301feb8-7b7c-43b9-821b-030487a6d577'}}} May 23 12:35:54.023112 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:35:54.023112 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:35:54.023112 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 23 12:35:54.023112 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 23 12:35:54.023112 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 12:35:54.023112 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 12:35:54.023112 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 23 12:35:54.023112 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 23 12:35:54.023112 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa in vm_state rescued. Cannot attach_volume while the instance is in this state. May 23 12:35:54.023112 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:35:54.023112 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:35:54.023112 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:35:54.023112 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:35:54.023112 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:35:54.023112 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:35:54.023112 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:35:54.023112 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:35:54.024651 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:35:54.024651 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:35:54.024651 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 12:35:54.024651 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 12:35:54.024651 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 12:35:54.024651 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 12:35:54.024651 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 12:35:54.024651 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 12:35:54.024651 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 23 12:35:54.024651 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 23 12:35:54.024651 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 23 12:35:54.024651 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 23 12:35:54.024651 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa while it is in vm_state rescued May 23 12:35:54.024651 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:35:54.024651 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:35:54.024651 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:35:54.024651 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:35:54.024651 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:35:54.024651 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:35:54.025929 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:35:54.025929 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:35:54.025929 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa while it is in vm_state rescued May 23 12:35:54.025929 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:35:54.025929 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-39b43e30-f717-4952-aac2-df28c8a1ae8c tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Returning 409 to user: Cannot 'attach_volume' instance 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa while it is in vm_state rescued {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:35:54.025929 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-39b43e30-f717-4952-aac2-df28c8a1ae8c tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "POST /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.121788 May 23 12:35:54.029222 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 154/316] 10.222.0.16 () {60 vars in 1322 bytes} [Mon May 23 12:35:53 2022] POST /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa/os-volume_attachments => generated 152 bytes in 129 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 23 12:35:54.039869 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-6f4f9c7b-1d8a-4e8e-81e8-1b3b40f0854b tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:35:54.040842 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-6f4f9c7b-1d8a-4e8e-81e8-1b3b40f0854b tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:54.054929 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6f4f9c7b-1d8a-4e8e-81e8-1b3b40f0854b tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:54.055810 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6f4f9c7b-1d8a-4e8e-81e8-1b3b40f0854b tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:54.056931 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6f4f9c7b-1d8a-4e8e-81e8-1b3b40f0854b tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:54.058395 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6f4f9c7b-1d8a-4e8e-81e8-1b3b40f0854b tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:54.198129 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:54.218259 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-6f4f9c7b-1d8a-4e8e-81e8-1b3b40f0854b tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "POST /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa/action" status: 202 len: 0 microversion: 2.1 time: 0.183643 May 23 12:35:54.220152 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 163/317] 10.222.0.16 () {60 vars in 1277 bytes} [Mon May 23 12:35:54 2022] POST /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:35:54.228627 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-1c5cb58b-9913-4f7c-b69c-02b3697dddab tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:54.230122 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-1c5cb58b-9913-4f7c-b69c-02b3697dddab tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:54.244321 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1c5cb58b-9913-4f7c-b69c-02b3697dddab tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:54.244780 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1c5cb58b-9913-4f7c-b69c-02b3697dddab tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:54.245566 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1c5cb58b-9913-4f7c-b69c-02b3697dddab tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:54.250988 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-32bcca2b-6b84-43fb-af2d-d90eeec89983 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:54.251946 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-32bcca2b-6b84-43fb-af2d-d90eeec89983 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:54.252150 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1c5cb58b-9913-4f7c-b69c-02b3697dddab tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:54.266099 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-32bcca2b-6b84-43fb-af2d-d90eeec89983 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:54.266811 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-32bcca2b-6b84-43fb-af2d-d90eeec89983 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:54.268082 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-32bcca2b-6b84-43fb-af2d-d90eeec89983 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:54.268708 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-32bcca2b-6b84-43fb-af2d-d90eeec89983 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:55.441638 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-32bcca2b-6b84-43fb-af2d-d90eeec89983 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:55.468580 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-32bcca2b-6b84-43fb-af2d-d90eeec89983 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 200 len: 1722 microversion: 2.1 time: 1.206816 May 23 12:35:55.469254 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 164/318] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:54 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 1722 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:55.515545 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-9613f4fc-c740-4e42-bd76-9f856c096b78 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:55.516361 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-9613f4fc-c740-4e42-bd76-9f856c096b78 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:55.540863 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9613f4fc-c740-4e42-bd76-9f856c096b78 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:55.541315 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9613f4fc-c740-4e42-bd76-9f856c096b78 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:55.542112 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9613f4fc-c740-4e42-bd76-9f856c096b78 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:55.542555 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9613f4fc-c740-4e42-bd76-9f856c096b78 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:55.697688 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1c5cb58b-9913-4f7c-b69c-02b3697dddab tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:55.720333 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-1c5cb58b-9913-4f7c-b69c-02b3697dddab tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1511 microversion: 2.1 time: 1.493596 May 23 12:35:55.724189 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 155/319] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:54 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1511 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:55.746371 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b317dd95-65a6-4bcc-91de-dbb0fd579342 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:55.748042 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-b317dd95-65a6-4bcc-91de-dbb0fd579342 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: a624bb16-d6b7-491a-9724-9a51af12140d] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:55.771381 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b317dd95-65a6-4bcc-91de-dbb0fd579342 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:55.773182 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b317dd95-65a6-4bcc-91de-dbb0fd579342 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:55.775417 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b317dd95-65a6-4bcc-91de-dbb0fd579342 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:55.777582 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b317dd95-65a6-4bcc-91de-dbb0fd579342 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:56.252938 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-9613f4fc-c740-4e42-bd76-9f856c096b78 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:56.266628 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-9613f4fc-c740-4e42-bd76-9f856c096b78 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:56.280382 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b317dd95-65a6-4bcc-91de-dbb0fd579342 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:56.281030 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-9613f4fc-c740-4e42-bd76-9f856c096b78 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:56.282527 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-9613f4fc-c740-4e42-bd76-9f856c096b78 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1741 microversion: 2.20 time: 0.812248 May 23 12:35:56.283289 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 165/320] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:35:55 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1741 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:35:56.291218 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b317dd95-65a6-4bcc-91de-dbb0fd579342 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d" status: 200 len: 1367 microversion: 2.1 time: 0.563726 May 23 12:35:56.292791 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 156/321] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:55 2022] GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d => generated 1367 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:56.493973 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-14d11b8a-ad1c-4d50-9cd7-3a4425122692 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:56.495077 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-14d11b8a-ad1c-4d50-9cd7-3a4425122692 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:56.502851 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-14d11b8a-ad1c-4d50-9cd7-3a4425122692 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:56.508938 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-14d11b8a-ad1c-4d50-9cd7-3a4425122692 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:56.509774 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-14d11b8a-ad1c-4d50-9cd7-3a4425122692 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:56.518519 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-14d11b8a-ad1c-4d50-9cd7-3a4425122692 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:56.743681 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-a0396c49-f13b-49ea-8eb2-64c593cdd392 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:56.744755 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-a0396c49-f13b-49ea-8eb2-64c593cdd392 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:56.760475 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a0396c49-f13b-49ea-8eb2-64c593cdd392 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:56.761198 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a0396c49-f13b-49ea-8eb2-64c593cdd392 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:56.762230 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a0396c49-f13b-49ea-8eb2-64c593cdd392 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:56.763012 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a0396c49-f13b-49ea-8eb2-64c593cdd392 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:56.775231 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-14d11b8a-ad1c-4d50-9cd7-3a4425122692 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:56.792605 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-14d11b8a-ad1c-4d50-9cd7-3a4425122692 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 200 len: 1722 microversion: 2.1 time: 0.302395 May 23 12:35:56.793850 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 166/322] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:56 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 1722 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:57.091638 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-a0396c49-f13b-49ea-8eb2-64c593cdd392 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:57.102157 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-a0396c49-f13b-49ea-8eb2-64c593cdd392 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1511 microversion: 2.1 time: 0.363177 May 23 12:35:57.103295 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 157/323] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:56 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1511 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:35:57.336243 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-98b3778d-76f0-4878-9771-628ecf217865 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:57.343161 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-6305870c-848d-475f-bdfa-4ea21c4fb2bd tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:57.343838 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-6305870c-848d-475f-bdfa-4ea21c4fb2bd tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: a624bb16-d6b7-491a-9724-9a51af12140d] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:57.346205 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-98b3778d-76f0-4878-9771-628ecf217865 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:57.366794 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6305870c-848d-475f-bdfa-4ea21c4fb2bd tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:57.367346 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6305870c-848d-475f-bdfa-4ea21c4fb2bd tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:57.369526 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-98b3778d-76f0-4878-9771-628ecf217865 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:57.370640 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-98b3778d-76f0-4878-9771-628ecf217865 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:57.372148 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-98b3778d-76f0-4878-9771-628ecf217865 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:57.373077 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-98b3778d-76f0-4878-9771-628ecf217865 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:57.373485 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6305870c-848d-475f-bdfa-4ea21c4fb2bd tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:57.375269 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6305870c-848d-475f-bdfa-4ea21c4fb2bd tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:57.767612 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-6305870c-848d-475f-bdfa-4ea21c4fb2bd tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:57.781031 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-6305870c-848d-475f-bdfa-4ea21c4fb2bd tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d" status: 200 len: 1367 microversion: 2.1 time: 0.473907 May 23 12:35:57.781882 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 158/324] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:57 2022] GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d => generated 1367 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:57.810123 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f81a27b2-f710-4794-a4ca-c23e612e3f62 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:57.810741 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-f81a27b2-f710-4794-a4ca-c23e612e3f62 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:57.819036 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f81a27b2-f710-4794-a4ca-c23e612e3f62 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:57.824899 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f81a27b2-f710-4794-a4ca-c23e612e3f62 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:57.826495 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f81a27b2-f710-4794-a4ca-c23e612e3f62 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:57.831931 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f81a27b2-f710-4794-a4ca-c23e612e3f62 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:57.858435 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-98b3778d-76f0-4878-9771-628ecf217865 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:57.882798 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-98b3778d-76f0-4878-9771-628ecf217865 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:57.889892 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-98b3778d-76f0-4878-9771-628ecf217865 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:57.891173 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-98b3778d-76f0-4878-9771-628ecf217865 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1741 microversion: 2.20 time: 0.593130 May 23 12:35:57.899508 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 167/325] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:35:57 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1741 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:35:58.204572 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f81a27b2-f710-4794-a4ca-c23e612e3f62 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:58.217149 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f81a27b2-f710-4794-a4ca-c23e612e3f62 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 200 len: 1722 microversion: 2.1 time: 0.410892 May 23 12:35:58.229649 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 159/326] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:57 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 1722 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:35:58.240127 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-8da7f4ed-d6e8-4cff-b727-88a3ace104bb tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:58.242494 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-8da7f4ed-d6e8-4cff-b727-88a3ace104bb tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:58.262161 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8da7f4ed-d6e8-4cff-b727-88a3ace104bb tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:58.262852 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8da7f4ed-d6e8-4cff-b727-88a3ace104bb tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:58.263542 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8da7f4ed-d6e8-4cff-b727-88a3ace104bb tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:58.265270 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8da7f4ed-d6e8-4cff-b727-88a3ace104bb tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:58.421556 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-48fa3aa1-e9f8-4c3a-9c27-3cf2a1df303a tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Action: 'create', calling method: .version_select at 0x7f095cb1bc10>, body: {"keypair": {"name": "tempest-TestShelveInstance-956008445", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQgTqZr84vSwGWehDDbFHsurWJUzArMX82qV4chN/fyKYB/+xQ1t8mOr6ij/y8sM1YUTHHGeptA/XGgIrnmccqoztookFnvC3Ys/UAfTxsbVa4KQ8E2GEwpOMStuq2IAw=="}} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:35:58.465982 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.quota [None req-48fa3aa1-e9f8-4c3a-9c27-3cf2a1df303a tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Getting quotas for project 835f4c15c26e47b7ba55aca85bfb66a8. Resources: {'key_pairs'} {{(pid=124200) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:35:58.472107 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.quota [None req-48fa3aa1-e9f8-4c3a-9c27-3cf2a1df303a tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Getting quotas for user 921861792ac246aa8772a636d45489c8 and project 835f4c15c26e47b7ba55aca85bfb66a8. Resources: {'key_pairs'} {{(pid=124200) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:35:58.537396 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-48fa3aa1-e9f8-4c3a-9c27-3cf2a1df303a tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.442139 May 23 12:35:58.547506 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 168/327] 10.222.0.16 () {60 vars in 1158 bytes} [Mon May 23 12:35:58 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:35:58.652798 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-8da7f4ed-d6e8-4cff-b727-88a3ace104bb tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:58.681607 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-8da7f4ed-d6e8-4cff-b727-88a3ace104bb tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1511 microversion: 2.1 time: 0.450341 May 23 12:35:58.696501 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 160/328] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:58 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1511 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:58.816360 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-2a9b0974-4d94-487c-837d-bc2a1e4d3996 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:58.817205 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-2a9b0974-4d94-487c-837d-bc2a1e4d3996 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: a624bb16-d6b7-491a-9724-9a51af12140d] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:58.854939 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2a9b0974-4d94-487c-837d-bc2a1e4d3996 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:58.856581 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2a9b0974-4d94-487c-837d-bc2a1e4d3996 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:58.859039 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2a9b0974-4d94-487c-837d-bc2a1e4d3996 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:58.860996 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2a9b0974-4d94-487c-837d-bc2a1e4d3996 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:58.920229 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-79a9d149-8855-458b-971c-e0c40e233dc2 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:58.920753 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-79a9d149-8855-458b-971c-e0c40e233dc2 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:58.930376 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:58.936857 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-79a9d149-8855-458b-971c-e0c40e233dc2 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:58.941063 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-79a9d149-8855-458b-971c-e0c40e233dc2 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:58.942330 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-79a9d149-8855-458b-971c-e0c40e233dc2 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:58.942996 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-79a9d149-8855-458b-971c-e0c40e233dc2 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:59.237437 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-2a9b0974-4d94-487c-837d-bc2a1e4d3996 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:59.264985 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-2a9b0974-4d94-487c-837d-bc2a1e4d3996 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d" status: 200 len: 1367 microversion: 2.1 time: 0.470088 May 23 12:35:59.275592 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 169/329] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:58 2022] GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d => generated 1367 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:59.281246 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-75813d25-2edf-486c-8af8-11b613a07b09 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:59.294946 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-75813d25-2edf-486c-8af8-11b613a07b09 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:59.306429 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-79a9d149-8855-458b-971c-e0c40e233dc2 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:59.329476 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-75813d25-2edf-486c-8af8-11b613a07b09 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:59.334691 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-75813d25-2edf-486c-8af8-11b613a07b09 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:59.337185 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-79a9d149-8855-458b-971c-e0c40e233dc2 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:59.344024 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-75813d25-2edf-486c-8af8-11b613a07b09 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:59.344784 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-75813d25-2edf-486c-8af8-11b613a07b09 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:59.351924 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-79a9d149-8855-458b-971c-e0c40e233dc2 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:59.353746 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-79a9d149-8855-458b-971c-e0c40e233dc2 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1741 microversion: 2.20 time: 0.440750 May 23 12:35:59.357947 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 161/330] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:35:58 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1741 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:35:59.704076 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-68456a93-a168-4dcd-b516-9280cfc003c4 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:35:59.704902 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-68456a93-a168-4dcd-b516-9280cfc003c4 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:35:59.723276 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-68456a93-a168-4dcd-b516-9280cfc003c4 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:59.723809 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-68456a93-a168-4dcd-b516-9280cfc003c4 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:59.727796 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-68456a93-a168-4dcd-b516-9280cfc003c4 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:59.728375 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-68456a93-a168-4dcd-b516-9280cfc003c4 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:35:59.950104 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-75813d25-2edf-486c-8af8-11b613a07b09 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:35:59.960066 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-75813d25-2edf-486c-8af8-11b613a07b09 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 200 len: 1699 microversion: 2.1 time: 0.682803 May 23 12:35:59.964900 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 170/331] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:59 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 1699 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:35:59.983046 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-1e94a7c0-9ba8-4458-943c-f7658255ba4f tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:35:59.992143 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1e94a7c0-9ba8-4458-943c-f7658255ba4f tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:35:59.993865 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1e94a7c0-9ba8-4458-943c-f7658255ba4f tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:00.022971 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-68456a93-a168-4dcd-b516-9280cfc003c4 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:00.037646 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-68456a93-a168-4dcd-b516-9280cfc003c4 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1517 microversion: 2.1 time: 0.339016 May 23 12:36:00.039209 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 162/332] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:35:59 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1517 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:00.188036 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-1e94a7c0-9ba8-4458-943c-f7658255ba4f tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Going to try to start instance {{(pid=124200) start /opt/stack/nova/nova/compute/api.py:2730}} May 23 12:36:00.284137 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-4d85134b-5236-4fb9-8bc2-dacc0e2a033e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:00.288755 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-4d85134b-5236-4fb9-8bc2-dacc0e2a033e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: a624bb16-d6b7-491a-9724-9a51af12140d] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:00.297948 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-1e94a7c0-9ba8-4458-943c-f7658255ba4f tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "POST /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e/action" status: 202 len: 0 microversion: 2.1 time: 0.317737 May 23 12:36:00.300494 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 171/333] 10.222.0.16 () {60 vars in 1277 bytes} [Mon May 23 12:35:59 2022] POST /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 12:36:00.310293 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4d85134b-5236-4fb9-8bc2-dacc0e2a033e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:00.311317 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4d85134b-5236-4fb9-8bc2-dacc0e2a033e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:00.315157 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-eb114950-4334-47e3-bee6-b3293c610404 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:00.318528 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4d85134b-5236-4fb9-8bc2-dacc0e2a033e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:00.319657 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4d85134b-5236-4fb9-8bc2-dacc0e2a033e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:00.341028 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-eb114950-4334-47e3-bee6-b3293c610404 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:00.369992 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-eb114950-4334-47e3-bee6-b3293c610404 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:00.370883 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-eb114950-4334-47e3-bee6-b3293c610404 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:00.373876 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-eb114950-4334-47e3-bee6-b3293c610404 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:00.374973 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-eb114950-4334-47e3-bee6-b3293c610404 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:01.084432 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-4d85134b-5236-4fb9-8bc2-dacc0e2a033e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:01.123109 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-4d85134b-5236-4fb9-8bc2-dacc0e2a033e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d" status: 200 len: 1367 microversion: 2.1 time: 0.843501 May 23 12:36:01.124689 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 163/334] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:00 2022] GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d => generated 1367 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:01.130876 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-ff0d8844-5b61-4555-930f-088a554019f6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:01.131801 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-ff0d8844-5b61-4555-930f-088a554019f6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:01.145740 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ff0d8844-5b61-4555-930f-088a554019f6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:01.146199 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ff0d8844-5b61-4555-930f-088a554019f6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:01.147707 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ff0d8844-5b61-4555-930f-088a554019f6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:01.148632 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ff0d8844-5b61-4555-930f-088a554019f6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:01.237367 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-eb114950-4334-47e3-bee6-b3293c610404 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:01.249551 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-eb114950-4334-47e3-bee6-b3293c610404 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 200 len: 1708 microversion: 2.1 time: 0.943611 May 23 12:36:01.250136 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 172/335] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:00 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 1708 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:01.662331 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-ff0d8844-5b61-4555-930f-088a554019f6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:01.689097 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-ff0d8844-5b61-4555-930f-088a554019f6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:01.696835 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-ff0d8844-5b61-4555-930f-088a554019f6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:01.698077 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-ff0d8844-5b61-4555-930f-088a554019f6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1741 microversion: 2.20 time: 0.571627 May 23 12:36:01.704381 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 164/336] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:36:01 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1741 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:36:01.811989 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-2f4cee6c-a837-473d-b350-0fa65cfb5c3d tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Action: 'create', calling method: .version_select at 0x7f095cabf4c0>, body: {"keypair": {"name": "tempest-keypair-25587323", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGh/yKHDSmsN1nIVn3b3ARyTAqQ07RXo3jWHThj3APq2LWs7NQnsq+S4nvl27cXiLM5yhQy2InxIKlqrM+EktsTn/IdxTBlONmvU8mEaOjdIQJpeJL8vH94HHtxdC4Qb6g=="}} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:36:01.834330 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.quota [None req-2f4cee6c-a837-473d-b350-0fa65cfb5c3d tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Getting quotas for project dcc45b8bab17498cadda8d64b3a76780. Resources: {'key_pairs'} {{(pid=124200) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:36:01.840165 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.quota [None req-2f4cee6c-a837-473d-b350-0fa65cfb5c3d tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Getting quotas for user 687208d733174bffa2783e6857401f39 and project dcc45b8bab17498cadda8d64b3a76780. Resources: {'key_pairs'} {{(pid=124200) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:36:01.872149 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-2f4cee6c-a837-473d-b350-0fa65cfb5c3d tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.065354 May 23 12:36:01.873613 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 173/337] 10.222.0.16 () {60 vars in 1158 bytes} [Mon May 23 12:36:01 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:36:02.143600 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-df9c62c8-940f-4b23-81ae-320b10489af8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:02.144418 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-df9c62c8-940f-4b23-81ae-320b10489af8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: a624bb16-d6b7-491a-9724-9a51af12140d] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:02.173489 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-df9c62c8-940f-4b23-81ae-320b10489af8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:02.174241 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-df9c62c8-940f-4b23-81ae-320b10489af8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:02.175357 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-df9c62c8-940f-4b23-81ae-320b10489af8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:02.183484 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-df9c62c8-940f-4b23-81ae-320b10489af8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:02.272416 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-b3dccdcf-7ec6-4d34-a95a-0d1ed2137669 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:02.273455 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-b3dccdcf-7ec6-4d34-a95a-0d1ed2137669 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:02.292146 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b3dccdcf-7ec6-4d34-a95a-0d1ed2137669 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:02.313985 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b3dccdcf-7ec6-4d34-a95a-0d1ed2137669 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:02.315911 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b3dccdcf-7ec6-4d34-a95a-0d1ed2137669 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:02.319031 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b3dccdcf-7ec6-4d34-a95a-0d1ed2137669 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:02.753000 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-df9c62c8-940f-4b23-81ae-320b10489af8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:02.770122 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-df9c62c8-940f-4b23-81ae-320b10489af8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d" status: 200 len: 1367 microversion: 2.1 time: 0.633178 May 23 12:36:02.774750 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 165/338] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:02 2022] GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d => generated 1367 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:36:02.806597 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-3b644f86-0bd0-4043-9c12-8f5d6fecae80 req-654b246e-80a7-47d7-8231-64e66880851b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a624bb16-d6b7-491a-9724-9a51af12140d", "name": "network-vif-plugged", "status": "completed", "tag": "214009e0-0102-49c7-bbc1-24d5fb2d2f55"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:36:02.831355 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-3b644f86-0bd0-4043-9c12-8f5d6fecae80 req-654b246e-80a7-47d7-8231-64e66880851b service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:02.832050 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-3b644f86-0bd0-4043-9c12-8f5d6fecae80 req-654b246e-80a7-47d7-8231-64e66880851b service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:02.853431 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-3b644f86-0bd0-4043-9c12-8f5d6fecae80 req-654b246e-80a7-47d7-8231-64e66880851b service nova] Creating event network-vif-plugged:214009e0-0102-49c7-bbc1-24d5fb2d2f55 for instance a624bb16-d6b7-491a-9724-9a51af12140d on hv-cinder-83699 May 23 12:36:02.883309 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-3b644f86-0bd0-4043-9c12-8f5d6fecae80 req-654b246e-80a7-47d7-8231-64e66880851b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091190 May 23 12:36:02.885835 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 166/339] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:36:02.901346 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-44421649-2ec3-44be-9c88-675b30eb65bf tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:02.902801 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-44421649-2ec3-44be-9c88-675b30eb65bf tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:02.915840 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-44421649-2ec3-44be-9c88-675b30eb65bf tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:02.917466 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-44421649-2ec3-44be-9c88-675b30eb65bf tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:02.924551 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-44421649-2ec3-44be-9c88-675b30eb65bf tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:02.926442 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-44421649-2ec3-44be-9c88-675b30eb65bf tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:02.983848 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-b3dccdcf-7ec6-4d34-a95a-0d1ed2137669 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:02.995473 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-b3dccdcf-7ec6-4d34-a95a-0d1ed2137669 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 200 len: 1708 microversion: 2.1 time: 0.730617 May 23 12:36:03.017727 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 174/340] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:02 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 1708 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:03.281920 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-44421649-2ec3-44be-9c88-675b30eb65bf tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:03.297500 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-44421649-2ec3-44be-9c88-675b30eb65bf tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:03.306689 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-44421649-2ec3-44be-9c88-675b30eb65bf tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:03.313038 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-44421649-2ec3-44be-9c88-675b30eb65bf tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1741 microversion: 2.20 time: 0.422708 May 23 12:36:03.316159 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 167/341] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:36:02 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1741 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:36:03.792746 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-0f157acc-866a-4aea-932b-5fbed1dab56f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:03.796749 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-0f157acc-866a-4aea-932b-5fbed1dab56f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: a624bb16-d6b7-491a-9724-9a51af12140d] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:03.806305 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0f157acc-866a-4aea-932b-5fbed1dab56f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:03.807074 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0f157acc-866a-4aea-932b-5fbed1dab56f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:03.808317 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0f157acc-866a-4aea-932b-5fbed1dab56f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:03.809873 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0f157acc-866a-4aea-932b-5fbed1dab56f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:03.992695 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-0f157acc-866a-4aea-932b-5fbed1dab56f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:04.002412 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-0f157acc-866a-4aea-932b-5fbed1dab56f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d" status: 200 len: 1367 microversion: 2.1 time: 0.214650 May 23 12:36:04.003524 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 175/342] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:03 2022] GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:04.025393 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-3d780313-ac13-4fd0-8b97-5532aee024d5 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:04.026544 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-3d780313-ac13-4fd0-8b97-5532aee024d5 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:04.035897 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3d780313-ac13-4fd0-8b97-5532aee024d5 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:04.036607 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3d780313-ac13-4fd0-8b97-5532aee024d5 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:04.037596 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3d780313-ac13-4fd0-8b97-5532aee024d5 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:04.038240 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3d780313-ac13-4fd0-8b97-5532aee024d5 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:04.061420 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell1:SELECT=100 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:36:04.244161 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-3d780313-ac13-4fd0-8b97-5532aee024d5 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:04.259477 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-3d780313-ac13-4fd0-8b97-5532aee024d5 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 200 len: 1708 microversion: 2.1 time: 0.238319 May 23 12:36:04.260834 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 168/343] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:04 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 1708 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:04.340222 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-726f7ca6-757f-4c43-ba78-3702b03cd49c tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:04.341043 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-726f7ca6-757f-4c43-ba78-3702b03cd49c tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:04.349696 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-726f7ca6-757f-4c43-ba78-3702b03cd49c tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:04.350608 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-726f7ca6-757f-4c43-ba78-3702b03cd49c tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:04.351543 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-726f7ca6-757f-4c43-ba78-3702b03cd49c tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:04.352222 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-726f7ca6-757f-4c43-ba78-3702b03cd49c tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:04.628788 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-726f7ca6-757f-4c43-ba78-3702b03cd49c tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:04.649621 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-726f7ca6-757f-4c43-ba78-3702b03cd49c tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:04.655589 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-726f7ca6-757f-4c43-ba78-3702b03cd49c tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:04.657239 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-726f7ca6-757f-4c43-ba78-3702b03cd49c tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1741 microversion: 2.20 time: 0.323091 May 23 12:36:04.657818 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 176/344] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:36:04 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1741 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:36:05.040336 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-854e3528-4eeb-401e-8771-fd35da242538 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:05.041114 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-8251443d-2311-4b5f-9c4b-4a1bf9f9ffd9 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1509357895", "imageRef": "bb11dfa4-2977-4163-8237-78c871c8437f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4833a70f-d11d-46d6-944f-14af0b04cad3"}], "security_groups": [{"name": "tempest-securitygroup--1495529118"}], "key_name": "tempest-keypair-25587323", "user_data": "}} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:36:05.041929 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-854e3528-4eeb-401e-8771-fd35da242538 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: a624bb16-d6b7-491a-9724-9a51af12140d] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:05.052253 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-854e3528-4eeb-401e-8771-fd35da242538 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:05.054038 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-854e3528-4eeb-401e-8771-fd35da242538 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:05.055747 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-854e3528-4eeb-401e-8771-fd35da242538 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:05.057006 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-854e3528-4eeb-401e-8771-fd35da242538 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:05.279351 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-854e3528-4eeb-401e-8771-fd35da242538 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:05.290868 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-854e3528-4eeb-401e-8771-fd35da242538 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d" status: 200 len: 1367 microversion: 2.1 time: 0.272797 May 23 12:36:05.301503 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 169/345] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:05 2022] GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d => generated 1367 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:05.314624 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-1919e6f4-6422-4eae-a0d4-4d5ef0dc9731 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:05.315503 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-1919e6f4-6422-4eae-a0d4-4d5ef0dc9731 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:05.322661 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1919e6f4-6422-4eae-a0d4-4d5ef0dc9731 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:05.323963 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1919e6f4-6422-4eae-a0d4-4d5ef0dc9731 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:05.325111 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1919e6f4-6422-4eae-a0d4-4d5ef0dc9731 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:05.325708 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1919e6f4-6422-4eae-a0d4-4d5ef0dc9731 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:05.531879 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1919e6f4-6422-4eae-a0d4-4d5ef0dc9731 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:05.540913 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-1919e6f4-6422-4eae-a0d4-4d5ef0dc9731 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 200 len: 1712 microversion: 2.1 time: 0.236323 May 23 12:36:05.557330 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 170/346] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:05 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 1712 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:05.679876 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-8bdf024a-aa76-469d-8b44-80d4100dda2e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:05.680775 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-8bdf024a-aa76-469d-8b44-80d4100dda2e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:05.690806 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8bdf024a-aa76-469d-8b44-80d4100dda2e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:05.691961 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8bdf024a-aa76-469d-8b44-80d4100dda2e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:05.693504 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8bdf024a-aa76-469d-8b44-80d4100dda2e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:05.694158 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8bdf024a-aa76-469d-8b44-80d4100dda2e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:06.004736 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-8bdf024a-aa76-469d-8b44-80d4100dda2e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:06.015883 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-8bdf024a-aa76-469d-8b44-80d4100dda2e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:06.017761 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-8bdf024a-aa76-469d-8b44-80d4100dda2e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:06.035927 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-8bdf024a-aa76-469d-8b44-80d4100dda2e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1741 microversion: 2.20 time: 0.360420 May 23 12:36:06.047401 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 171/347] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:36:05 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1741 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:36:06.311009 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-a42ec7a9-0590-4803-9b6e-b35f1d9db015 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:06.312114 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-a42ec7a9-0590-4803-9b6e-b35f1d9db015 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: a624bb16-d6b7-491a-9724-9a51af12140d] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:06.320028 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a42ec7a9-0590-4803-9b6e-b35f1d9db015 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:06.320830 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a42ec7a9-0590-4803-9b6e-b35f1d9db015 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:06.321575 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a42ec7a9-0590-4803-9b6e-b35f1d9db015 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:06.322932 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a42ec7a9-0590-4803-9b6e-b35f1d9db015 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:06.493942 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-a42ec7a9-0590-4803-9b6e-b35f1d9db015 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:06.506071 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-a42ec7a9-0590-4803-9b6e-b35f1d9db015 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d" status: 200 len: 1557 microversion: 2.1 time: 0.199189 May 23 12:36:06.507837 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 172/348] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:06 2022] GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d => generated 1557 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:06.529651 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-54eb2b10-ff01-4da1-b276-62a024facbd0 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:06.530191 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-54eb2b10-ff01-4da1-b276-62a024facbd0 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: a624bb16-d6b7-491a-9724-9a51af12140d] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:06.543213 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-54eb2b10-ff01-4da1-b276-62a024facbd0 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:06.543819 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-54eb2b10-ff01-4da1-b276-62a024facbd0 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:06.544639 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-54eb2b10-ff01-4da1-b276-62a024facbd0 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:06.545075 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-54eb2b10-ff01-4da1-b276-62a024facbd0 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:06.638413 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-54eb2b10-ff01-4da1-b276-62a024facbd0 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.119248 May 23 12:36:06.639382 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 173/349] 10.222.0.16 () {58 vars in 1274 bytes} [Mon May 23 12:36:06 2022] GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d/os-interface => generated 285 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:36:07.060811 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-3f0558e5-3d7b-4d46-89e3-ffc7cb08bbb7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:07.062971 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-3f0558e5-3d7b-4d46-89e3-ffc7cb08bbb7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:07.078586 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3f0558e5-3d7b-4d46-89e3-ffc7cb08bbb7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:07.079073 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3f0558e5-3d7b-4d46-89e3-ffc7cb08bbb7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:07.080015 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3f0558e5-3d7b-4d46-89e3-ffc7cb08bbb7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:07.080479 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3f0558e5-3d7b-4d46-89e3-ffc7cb08bbb7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:07.252217 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-3f0558e5-3d7b-4d46-89e3-ffc7cb08bbb7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:07.262128 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-3f0558e5-3d7b-4d46-89e3-ffc7cb08bbb7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:07.263725 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-3f0558e5-3d7b-4d46-89e3-ffc7cb08bbb7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:07.265304 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-3f0558e5-3d7b-4d46-89e3-ffc7cb08bbb7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1741 microversion: 2.20 time: 0.211608 May 23 12:36:07.265994 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 174/350] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:36:07 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1741 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:36:08.175716 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-be751c1c-2f01-4787-9601-56e64f54e20d req-36375bb3-d265-401d-99e6-8aeb7b5aff99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a624bb16-d6b7-491a-9724-9a51af12140d", "tag": "214009e0-0102-49c7-bbc1-24d5fb2d2f55"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:36:08.187260 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-be751c1c-2f01-4787-9601-56e64f54e20d req-36375bb3-d265-401d-99e6-8aeb7b5aff99 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:08.187759 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-be751c1c-2f01-4787-9601-56e64f54e20d req-36375bb3-d265-401d-99e6-8aeb7b5aff99 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:08.208746 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-be751c1c-2f01-4787-9601-56e64f54e20d req-36375bb3-d265-401d-99e6-8aeb7b5aff99 service nova] Creating event network-changed:214009e0-0102-49c7-bbc1-24d5fb2d2f55 for instance a624bb16-d6b7-491a-9724-9a51af12140d on hv-cinder-83699 May 23 12:36:08.214697 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-be751c1c-2f01-4787-9601-56e64f54e20d req-36375bb3-d265-401d-99e6-8aeb7b5aff99 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045928 May 23 12:36:08.215455 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 175/351] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:36:08.286143 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-400c11ad-6f78-4211-9184-486eac365aac tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:08.287097 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-400c11ad-6f78-4211-9184-486eac365aac tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:08.301329 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-400c11ad-6f78-4211-9184-486eac365aac tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:08.306942 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-400c11ad-6f78-4211-9184-486eac365aac tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:08.309441 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-400c11ad-6f78-4211-9184-486eac365aac tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:08.310242 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-400c11ad-6f78-4211-9184-486eac365aac tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:08.568851 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-400c11ad-6f78-4211-9184-486eac365aac tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:08.577872 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-400c11ad-6f78-4211-9184-486eac365aac tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:08.579398 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-400c11ad-6f78-4211-9184-486eac365aac tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:08.586413 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-400c11ad-6f78-4211-9184-486eac365aac tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1741 microversion: 2.20 time: 0.299329 May 23 12:36:08.588318 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 176/352] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:36:08 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1741 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:36:09.608639 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b3035619-41a1-4883-b107-735518238490 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:09.609926 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-b3035619-41a1-4883-b107-735518238490 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:09.633731 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b3035619-41a1-4883-b107-735518238490 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:09.636514 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b3035619-41a1-4883-b107-735518238490 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:09.638030 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b3035619-41a1-4883-b107-735518238490 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:09.640355 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b3035619-41a1-4883-b107-735518238490 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:09.838484 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b3035619-41a1-4883-b107-735518238490 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:09.851016 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b3035619-41a1-4883-b107-735518238490 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:09.852855 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b3035619-41a1-4883-b107-735518238490 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:09.854133 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b3035619-41a1-4883-b107-735518238490 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1741 microversion: 2.20 time: 0.252025 May 23 12:36:09.854905 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 177/353] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:36:09 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1741 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:36:10.874911 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-e87f3a64-b74e-478a-9c02-a3bb899fe350 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:10.875598 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-e87f3a64-b74e-478a-9c02-a3bb899fe350 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:10.891824 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e87f3a64-b74e-478a-9c02-a3bb899fe350 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:10.892305 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e87f3a64-b74e-478a-9c02-a3bb899fe350 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:10.893086 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e87f3a64-b74e-478a-9c02-a3bb899fe350 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:10.893706 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e87f3a64-b74e-478a-9c02-a3bb899fe350 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:11.083013 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-e87f3a64-b74e-478a-9c02-a3bb899fe350 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:11.095944 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-e87f3a64-b74e-478a-9c02-a3bb899fe350 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:11.098098 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-e87f3a64-b74e-478a-9c02-a3bb899fe350 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:11.099637 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-e87f3a64-b74e-478a-9c02-a3bb899fe350 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1741 microversion: 2.20 time: 0.228626 May 23 12:36:11.111851 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 178/354] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:36:10 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1741 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:36:11.779691 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.network.neutron [None req-8251443d-2311-4b5f-9c4b-4a1bf9f9ffd9 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] validate_networks() for [('4833a70f-d11d-46d6-944f-14af0b04cad3', None, None, None, None, None)] {{(pid=124200) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 12:36:11.853086 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell0:SELECT=8 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:36:11.966523 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=2 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:36:12.119918 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-475034f5-dfc0-459f-81b7-4e7ac30da509 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:12.120468 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-475034f5-dfc0-459f-81b7-4e7ac30da509 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:12.127271 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-475034f5-dfc0-459f-81b7-4e7ac30da509 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:12.127746 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-475034f5-dfc0-459f-81b7-4e7ac30da509 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:12.128577 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-475034f5-dfc0-459f-81b7-4e7ac30da509 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:12.129022 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-475034f5-dfc0-459f-81b7-4e7ac30da509 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:12.184311 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-8251443d-2311-4b5f-9c4b-4a1bf9f9ffd9 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Flavor limits 0:0:0 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 12:36:12.184740 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-8251443d-2311-4b5f-9c4b-4a1bf9f9ffd9 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Image limits 0:0:0 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 12:36:12.185216 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-8251443d-2311-4b5f-9c4b-4a1bf9f9ffd9 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Flavor pref 0:0:0 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 12:36:12.185626 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-8251443d-2311-4b5f-9c4b-4a1bf9f9ffd9 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Image pref 0:0:0 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 12:36:12.186041 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-8251443d-2311-4b5f-9c4b-4a1bf9f9ffd9 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 12:36:12.194873 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8251443d-2311-4b5f-9c4b-4a1bf9f9ffd9 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:12.195319 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8251443d-2311-4b5f-9c4b-4a1bf9f9ffd9 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:12.196128 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8251443d-2311-4b5f-9c4b-4a1bf9f9ffd9 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:12.196600 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8251443d-2311-4b5f-9c4b-4a1bf9f9ffd9 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:12.214912 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.quota [None req-8251443d-2311-4b5f-9c4b-4a1bf9f9ffd9 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Getting quotas for project dcc45b8bab17498cadda8d64b3a76780. Resources: {'instances', 'cores', 'ram'} {{(pid=124200) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:36:12.218932 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.quota [None req-8251443d-2311-4b5f-9c4b-4a1bf9f9ffd9 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Getting quotas for user 687208d733174bffa2783e6857401f39 and project dcc45b8bab17498cadda8d64b3a76780. Resources: {'instances', 'cores', 'ram'} {{(pid=124200) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:36:12.231924 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-8251443d-2311-4b5f-9c4b-4a1bf9f9ffd9 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Going to run 1 instances... {{(pid=124200) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 12:36:12.234574 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-8251443d-2311-4b5f-9c4b-4a1bf9f9ffd9 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb11dfa4-2977-4163-8237-78c871c8437f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124200) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 12:36:12.274831 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-475034f5-dfc0-459f-81b7-4e7ac30da509 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:12.284209 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-475034f5-dfc0-459f-81b7-4e7ac30da509 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:12.285483 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-8251443d-2311-4b5f-9c4b-4a1bf9f9ffd9 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 7.251217 May 23 12:36:12.286304 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 177/355] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 23 12:36:05 2022] POST /compute/v2.1/servers => generated 409 bytes in 7253 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 12:36:12.286416 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-475034f5-dfc0-459f-81b7-4e7ac30da509 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:12.288240 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-475034f5-dfc0-459f-81b7-4e7ac30da509 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1741 microversion: 2.20 time: 0.172311 May 23 12:36:12.288830 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 179/356] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:36:12 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1741 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:36:12.297722 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-87b69464-00db-47e7-8280-9fe2a05ffa2b tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:12.298893 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-87b69464-00db-47e7-8280-9fe2a05ffa2b tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:12.376446 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-87b69464-00db-47e7-8280-9fe2a05ffa2b tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:12.388456 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-87b69464-00db-47e7-8280-9fe2a05ffa2b tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f" status: 200 len: 1244 microversion: 2.1 time: 0.094810 May 23 12:36:12.390201 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 178/357] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:12 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f => generated 1244 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:13.307032 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-e609125b-739a-40d0-ae11-6d89761923da tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:13.307648 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-e609125b-739a-40d0-ae11-6d89761923da tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:13.314276 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e609125b-739a-40d0-ae11-6d89761923da tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:13.314726 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e609125b-739a-40d0-ae11-6d89761923da tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:13.315495 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e609125b-739a-40d0-ae11-6d89761923da tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:13.315932 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e609125b-739a-40d0-ae11-6d89761923da tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:13.412010 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-a4d9de27-0e9a-4d12-bb47-f27a95434ec7 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:13.412010 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-a4d9de27-0e9a-4d12-bb47-f27a95434ec7 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:13.415516 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a4d9de27-0e9a-4d12-bb47-f27a95434ec7 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:13.416035 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a4d9de27-0e9a-4d12-bb47-f27a95434ec7 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:13.416889 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a4d9de27-0e9a-4d12-bb47-f27a95434ec7 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:13.417416 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a4d9de27-0e9a-4d12-bb47-f27a95434ec7 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:13.452225 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-e609125b-739a-40d0-ae11-6d89761923da tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:13.461034 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-e609125b-739a-40d0-ae11-6d89761923da tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:13.462564 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-e609125b-739a-40d0-ae11-6d89761923da tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:13.463920 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-e609125b-739a-40d0-ae11-6d89761923da tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1723 microversion: 2.20 time: 0.160959 May 23 12:36:13.464512 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 180/358] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:36:13 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:36:13.480525 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-a4d9de27-0e9a-4d12-bb47-f27a95434ec7 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:13.488331 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-a4d9de27-0e9a-4d12-bb47-f27a95434ec7 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f" status: 200 len: 1240 microversion: 2.1 time: 0.085268 May 23 12:36:13.488843 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 179/359] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:13 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f => generated 1240 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:36:14.482216 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-dfd8e5c8-90fa-4d99-92aa-843a12358697 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:14.482823 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-dfd8e5c8-90fa-4d99-92aa-843a12358697 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:14.489285 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dfd8e5c8-90fa-4d99-92aa-843a12358697 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:14.489731 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dfd8e5c8-90fa-4d99-92aa-843a12358697 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:14.490496 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dfd8e5c8-90fa-4d99-92aa-843a12358697 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:14.490929 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dfd8e5c8-90fa-4d99-92aa-843a12358697 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:14.506233 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-429563c2-9f42-4a4a-aad6-e4a4f4a1ca69 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:14.506842 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-429563c2-9f42-4a4a-aad6-e4a4f4a1ca69 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:14.514405 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-429563c2-9f42-4a4a-aad6-e4a4f4a1ca69 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:14.514855 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-429563c2-9f42-4a4a-aad6-e4a4f4a1ca69 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:14.515677 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-429563c2-9f42-4a4a-aad6-e4a4f4a1ca69 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:14.516113 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-429563c2-9f42-4a4a-aad6-e4a4f4a1ca69 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:14.589598 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-429563c2-9f42-4a4a-aad6-e4a4f4a1ca69 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:14.597400 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-429563c2-9f42-4a4a-aad6-e4a4f4a1ca69 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f" status: 200 len: 1240 microversion: 2.1 time: 0.094972 May 23 12:36:14.598562 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 180/360] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:14 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f => generated 1240 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:36:14.920154 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-dfd8e5c8-90fa-4d99-92aa-843a12358697 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:14.928814 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-dfd8e5c8-90fa-4d99-92aa-843a12358697 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:14.931076 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-dfd8e5c8-90fa-4d99-92aa-843a12358697 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:14.932257 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-dfd8e5c8-90fa-4d99-92aa-843a12358697 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1723 microversion: 2.20 time: 0.453943 May 23 12:36:14.932811 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 181/361] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:36:14 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1723 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:36:15.501419 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-a3926556-0d2c-4307-afda-d5ede06f2294 req-2a90a520-f871-47bb-811b-28fde050c79d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce37af9c-e5f8-4233-97f3-4280a2114e45", "name": "network-vif-unplugged", "status": "completed", "tag": "357ce430-3b90-4a7c-b2f3-c2ee303501e4"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:36:15.514459 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-a3926556-0d2c-4307-afda-d5ede06f2294 req-2a90a520-f871-47bb-811b-28fde050c79d service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:15.515789 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-a3926556-0d2c-4307-afda-d5ede06f2294 req-2a90a520-f871-47bb-811b-28fde050c79d service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:15.530778 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-a3926556-0d2c-4307-afda-d5ede06f2294 req-2a90a520-f871-47bb-811b-28fde050c79d service nova] Creating event network-vif-unplugged:357ce430-3b90-4a7c-b2f3-c2ee303501e4 for instance ce37af9c-e5f8-4233-97f3-4280a2114e45 on hv-cinder-83699 May 23 12:36:15.537770 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-a3926556-0d2c-4307-afda-d5ede06f2294 req-2a90a520-f871-47bb-811b-28fde050c79d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041393 May 23 12:36:15.539394 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 181/362] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:36:15.615986 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-7492e3c3-2cea-4753-8b5f-eecf260d723e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:15.617568 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-7492e3c3-2cea-4753-8b5f-eecf260d723e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:15.625691 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7492e3c3-2cea-4753-8b5f-eecf260d723e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:15.626394 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7492e3c3-2cea-4753-8b5f-eecf260d723e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:15.627333 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7492e3c3-2cea-4753-8b5f-eecf260d723e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:15.627955 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7492e3c3-2cea-4753-8b5f-eecf260d723e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:15.700296 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-7492e3c3-2cea-4753-8b5f-eecf260d723e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:15.709753 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-7492e3c3-2cea-4753-8b5f-eecf260d723e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f" status: 200 len: 1304 microversion: 2.1 time: 0.099138 May 23 12:36:15.720781 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 182/363] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:15 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f => generated 1304 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:15.951768 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-72fcd6dd-098b-4ba3-8d07-262cba90c0c0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:15.952537 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-72fcd6dd-098b-4ba3-8d07-262cba90c0c0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:15.959021 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-72fcd6dd-098b-4ba3-8d07-262cba90c0c0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:15.959469 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-72fcd6dd-098b-4ba3-8d07-262cba90c0c0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:15.961020 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-72fcd6dd-098b-4ba3-8d07-262cba90c0c0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:15.961241 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-72fcd6dd-098b-4ba3-8d07-262cba90c0c0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:16.096334 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-72fcd6dd-098b-4ba3-8d07-262cba90c0c0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:16.104948 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-72fcd6dd-098b-4ba3-8d07-262cba90c0c0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:16.106449 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-72fcd6dd-098b-4ba3-8d07-262cba90c0c0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:16.107590 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-72fcd6dd-098b-4ba3-8d07-262cba90c0c0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1666 microversion: 2.20 time: 0.160575 May 23 12:36:16.108151 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 182/364] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:36:15 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1666 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:36:16.134898 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-dc3e2900-9583-481b-8ce7-47a819101bec tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10b86ab5-b3ed-414a-9916-79a294558267"}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:36:16.136084 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-dc3e2900-9583-481b-8ce7-47a819101bec tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:16.142649 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dc3e2900-9583-481b-8ce7-47a819101bec tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:16.143098 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dc3e2900-9583-481b-8ce7-47a819101bec tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:16.143866 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dc3e2900-9583-481b-8ce7-47a819101bec tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:16.144493 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dc3e2900-9583-481b-8ce7-47a819101bec tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:16.458198 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:36:16.477928 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-dc3e2900-9583-481b-8ce7-47a819101bec tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "POST /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.355433 May 23 12:36:16.484261 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 183/365] 10.222.0.16 () {62 vars in 1363 bytes} [Mon May 23 12:36:16 2022] POST /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45/os-volume_attachments => generated 188 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 12:36:16.625033 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-32033c98-0fd6-40a3-a004-25b5f33aa665 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:36:16.625616 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-32033c98-0fd6-40a3-a004-25b5f33aa665 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:16.633024 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-32033c98-0fd6-40a3-a004-25b5f33aa665 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:16.633484 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-32033c98-0fd6-40a3-a004-25b5f33aa665 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:16.634269 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-32033c98-0fd6-40a3-a004-25b5f33aa665 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:16.634699 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-32033c98-0fd6-40a3-a004-25b5f33aa665 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:16.682668 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:36:16.728827 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-391bbf5e-962d-43a5-9b7c-5d9d6f141efb tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:16.729373 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-391bbf5e-962d-43a5-9b7c-5d9d6f141efb tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:16.731874 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-32033c98-0fd6-40a3-a004-25b5f33aa665 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "POST /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45/action" status: 202 len: 0 microversion: 2.20 time: 0.110691 May 23 12:36:16.735815 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 183/366] 10.222.0.16 () {62 vars in 1318 bytes} [Mon May 23 12:36:16 2022] POST /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 23 12:36:16.736629 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-391bbf5e-962d-43a5-9b7c-5d9d6f141efb tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:16.737264 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-391bbf5e-962d-43a5-9b7c-5d9d6f141efb tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:16.738202 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-391bbf5e-962d-43a5-9b7c-5d9d6f141efb tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:16.738834 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-391bbf5e-962d-43a5-9b7c-5d9d6f141efb tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:16.741240 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-592023cc-6f8c-426e-91ea-34d9dd84dbda tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:16.742544 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-592023cc-6f8c-426e-91ea-34d9dd84dbda tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:16.748626 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-592023cc-6f8c-426e-91ea-34d9dd84dbda tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:16.749627 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-592023cc-6f8c-426e-91ea-34d9dd84dbda tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:16.751060 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-592023cc-6f8c-426e-91ea-34d9dd84dbda tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:16.751522 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-592023cc-6f8c-426e-91ea-34d9dd84dbda tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:16.936862 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-391bbf5e-962d-43a5-9b7c-5d9d6f141efb tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:16.958513 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-391bbf5e-962d-43a5-9b7c-5d9d6f141efb tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f" status: 200 len: 1370 microversion: 2.1 time: 0.234524 May 23 12:36:16.962276 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 184/367] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:16 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f => generated 1370 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:17.034226 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-592023cc-6f8c-426e-91ea-34d9dd84dbda tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:17.046839 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-592023cc-6f8c-426e-91ea-34d9dd84dbda tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:17.049496 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-592023cc-6f8c-426e-91ea-34d9dd84dbda tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:17.050836 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-592023cc-6f8c-426e-91ea-34d9dd84dbda tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1752 microversion: 2.20 time: 0.313773 May 23 12:36:17.051412 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 184/368] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:36:16 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1752 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:36:17.165816 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-6af60894-a164-4070-b604-af2e00d9b059 req-acdebb48-ba1f-405a-b3e1-19fdfb494479 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64486ed1-2721-4c2a-a2fb-a96f3a82f32f", "tag": "ccd5bdc8-a41b-4e8c-aebe-0858a605b65b"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:36:17.175649 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-6af60894-a164-4070-b604-af2e00d9b059 req-acdebb48-ba1f-405a-b3e1-19fdfb494479 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:17.176025 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-6af60894-a164-4070-b604-af2e00d9b059 req-acdebb48-ba1f-405a-b3e1-19fdfb494479 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:17.202088 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-6af60894-a164-4070-b604-af2e00d9b059 req-acdebb48-ba1f-405a-b3e1-19fdfb494479 service nova] Creating event network-changed:ccd5bdc8-a41b-4e8c-aebe-0858a605b65b for instance 64486ed1-2721-4c2a-a2fb-a96f3a82f32f on hv-cinder-83699 May 23 12:36:17.207878 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-6af60894-a164-4070-b604-af2e00d9b059 req-acdebb48-ba1f-405a-b3e1-19fdfb494479 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047374 May 23 12:36:17.209048 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 185/369] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:36:17.653686 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-aeb29100-f250-47b2-a888-a7d766268122 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1542407281", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-956008445", "security_groups": [{"name": "tempest-secgroup-smoke-594270591"}], "networks": [{"uuid": "eba13816-fd74-4783-a2bd-29f9a2d3200d"}], "block_device_mapping_v2": [{"uuid": "b77a4b7e-d2b3-49e9-910a-c3dd959b159c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:36:17.784622 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.network.neutron [None req-aeb29100-f250-47b2-a888-a7d766268122 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] validate_networks() for [('eba13816-fd74-4783-a2bd-29f9a2d3200d', None, None, None, None, None)] {{(pid=124200) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 12:36:17.978121 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f3041925-c8e0-4c82-ac34-bebf65d83494 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:17.978923 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-f3041925-c8e0-4c82-ac34-bebf65d83494 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:17.985214 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f3041925-c8e0-4c82-ac34-bebf65d83494 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:17.985660 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f3041925-c8e0-4c82-ac34-bebf65d83494 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:17.986438 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f3041925-c8e0-4c82-ac34-bebf65d83494 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:17.986887 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f3041925-c8e0-4c82-ac34-bebf65d83494 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:18.191650 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f3041925-c8e0-4c82-ac34-bebf65d83494 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:18.199558 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f3041925-c8e0-4c82-ac34-bebf65d83494 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f" status: 200 len: 1370 microversion: 2.1 time: 0.226973 May 23 12:36:18.202241 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 186/370] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:17 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f => generated 1370 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:18.206795 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-2654b4f0-f26e-4200-b7c2-ef96fa3d3244 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:18.207422 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-2654b4f0-f26e-4200-b7c2-ef96fa3d3244 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:18.213891 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2654b4f0-f26e-4200-b7c2-ef96fa3d3244 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:18.214344 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2654b4f0-f26e-4200-b7c2-ef96fa3d3244 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:18.215121 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2654b4f0-f26e-4200-b7c2-ef96fa3d3244 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:18.215561 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2654b4f0-f26e-4200-b7c2-ef96fa3d3244 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:18.235321 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-aeb29100-f250-47b2-a888-a7d766268122 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Flavor limits 0:0:0 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 12:36:18.235745 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-aeb29100-f250-47b2-a888-a7d766268122 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Image limits 0:0:0 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 12:36:18.236240 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-aeb29100-f250-47b2-a888-a7d766268122 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Flavor pref 0:0:0 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 12:36:18.236645 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-aeb29100-f250-47b2-a888-a7d766268122 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Image pref 0:0:0 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 12:36:18.237051 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-aeb29100-f250-47b2-a888-a7d766268122 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 12:36:18.246858 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-aeb29100-f250-47b2-a888-a7d766268122 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:18.247303 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-aeb29100-f250-47b2-a888-a7d766268122 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:18.248092 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-aeb29100-f250-47b2-a888-a7d766268122 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:18.248551 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-aeb29100-f250-47b2-a888-a7d766268122 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:18.266311 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.quota [None req-aeb29100-f250-47b2-a888-a7d766268122 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Getting quotas for project 835f4c15c26e47b7ba55aca85bfb66a8. Resources: {'instances', 'cores', 'ram'} {{(pid=124200) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:36:18.270209 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.quota [None req-aeb29100-f250-47b2-a888-a7d766268122 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Getting quotas for user 921861792ac246aa8772a636d45489c8 and project 835f4c15c26e47b7ba55aca85bfb66a8. Resources: {'instances', 'cores', 'ram'} {{(pid=124200) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:36:18.327896 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-aeb29100-f250-47b2-a888-a7d766268122 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Going to run 1 instances... {{(pid=124200) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 12:36:18.330042 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-aeb29100-f250-47b2-a888-a7d766268122 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b77a4b7e-d2b3-49e9-910a-c3dd959b159c',volume_size=None,volume_type=None)] {{(pid=124200) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 12:36:18.345612 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-2654b4f0-f26e-4200-b7c2-ef96fa3d3244 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:18.358233 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-2654b4f0-f26e-4200-b7c2-ef96fa3d3244 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:18.359831 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-2654b4f0-f26e-4200-b7c2-ef96fa3d3244 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:18.361256 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-2654b4f0-f26e-4200-b7c2-ef96fa3d3244 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1752 microversion: 2.20 time: 0.158051 May 23 12:36:18.372680 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 187/371] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:36:18 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:36:18.456322 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-aeb29100-f250-47b2-a888-a7d766268122 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.807294 May 23 12:36:18.456959 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 185/372] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 23 12:36:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 12:36:18.468330 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-35046afb-0a59-4674-b779-fbaac23133af tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:18.469086 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-35046afb-0a59-4674-b779-fbaac23133af tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:18.523608 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-35046afb-0a59-4674-b779-fbaac23133af tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:18.530591 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-35046afb-0a59-4674-b779-fbaac23133af tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1088 microversion: 2.1 time: 0.066277 May 23 12:36:18.531154 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 188/373] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:18 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1088 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:19.216708 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-b497a2fa-2733-45d0-bb16-90b8cac3a058 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:19.217233 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-b497a2fa-2733-45d0-bb16-90b8cac3a058 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:19.223814 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b497a2fa-2733-45d0-bb16-90b8cac3a058 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:19.224311 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b497a2fa-2733-45d0-bb16-90b8cac3a058 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:19.225088 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b497a2fa-2733-45d0-bb16-90b8cac3a058 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:19.225534 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b497a2fa-2733-45d0-bb16-90b8cac3a058 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:19.360248 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-b497a2fa-2733-45d0-bb16-90b8cac3a058 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:19.368432 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-b497a2fa-2733-45d0-bb16-90b8cac3a058 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f" status: 200 len: 1370 microversion: 2.1 time: 0.155648 May 23 12:36:19.377664 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 186/374] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:19 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:19.379111 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0263a68e-98c4-4f7d-896e-6710adaeb22e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:19.379728 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-0263a68e-98c4-4f7d-896e-6710adaeb22e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:19.387490 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0263a68e-98c4-4f7d-896e-6710adaeb22e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:19.387945 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0263a68e-98c4-4f7d-896e-6710adaeb22e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:19.388741 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0263a68e-98c4-4f7d-896e-6710adaeb22e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:19.389182 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0263a68e-98c4-4f7d-896e-6710adaeb22e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:19.547234 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-b8ea741b-5062-495d-95de-06f63c9a9915 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:19.548080 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-b8ea741b-5062-495d-95de-06f63c9a9915 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:19.560430 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b8ea741b-5062-495d-95de-06f63c9a9915 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:19.561111 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b8ea741b-5062-495d-95de-06f63c9a9915 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:19.562057 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b8ea741b-5062-495d-95de-06f63c9a9915 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:19.563384 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b8ea741b-5062-495d-95de-06f63c9a9915 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:19.636835 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0263a68e-98c4-4f7d-896e-6710adaeb22e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:19.649995 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0263a68e-98c4-4f7d-896e-6710adaeb22e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:19.651943 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0263a68e-98c4-4f7d-896e-6710adaeb22e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:19.653691 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-0263a68e-98c4-4f7d-896e-6710adaeb22e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1754 microversion: 2.20 time: 0.278611 May 23 12:36:19.664748 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 189/375] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:36:19 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1754 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:36:19.668095 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-b8ea741b-5062-495d-95de-06f63c9a9915 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:19.685070 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-b8ea741b-5062-495d-95de-06f63c9a9915 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1194 microversion: 2.1 time: 0.141903 May 23 12:36:19.692561 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 187/376] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:19 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1194 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:20.385439 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-aeaa2822-1492-471f-bae3-8770ee3e18e1 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:20.386677 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-aeaa2822-1492-471f-bae3-8770ee3e18e1 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:20.393900 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-aeaa2822-1492-471f-bae3-8770ee3e18e1 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:20.394356 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-aeaa2822-1492-471f-bae3-8770ee3e18e1 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:20.395137 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-aeaa2822-1492-471f-bae3-8770ee3e18e1 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:20.395579 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-aeaa2822-1492-471f-bae3-8770ee3e18e1 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:20.616768 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-aeaa2822-1492-471f-bae3-8770ee3e18e1 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:20.628263 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-aeaa2822-1492-471f-bae3-8770ee3e18e1 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f" status: 200 len: 1370 microversion: 2.1 time: 0.246809 May 23 12:36:20.629001 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 190/377] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:20 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f => generated 1370 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:20.682515 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-040c736d-4331-407b-be8a-46e9ae5522b5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:20.682515 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-040c736d-4331-407b-be8a-46e9ae5522b5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:20.687992 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-040c736d-4331-407b-be8a-46e9ae5522b5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:20.688911 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-040c736d-4331-407b-be8a-46e9ae5522b5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:20.689866 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-040c736d-4331-407b-be8a-46e9ae5522b5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:20.690751 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-040c736d-4331-407b-be8a-46e9ae5522b5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:20.703401 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-538ebb52-9565-42c8-9cac-ea1b74330f67 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:20.704444 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-538ebb52-9565-42c8-9cac-ea1b74330f67 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:20.743729 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-538ebb52-9565-42c8-9cac-ea1b74330f67 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:20.744579 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-538ebb52-9565-42c8-9cac-ea1b74330f67 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:20.745556 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-538ebb52-9565-42c8-9cac-ea1b74330f67 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:20.746143 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-538ebb52-9565-42c8-9cac-ea1b74330f67 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:21.037217 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-040c736d-4331-407b-be8a-46e9ae5522b5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:21.046334 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-040c736d-4331-407b-be8a-46e9ae5522b5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:21.047827 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-040c736d-4331-407b-be8a-46e9ae5522b5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:21.049215 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-040c736d-4331-407b-be8a-46e9ae5522b5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1810 microversion: 2.20 time: 0.380433 May 23 12:36:21.049890 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 188/378] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:36:20 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1810 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:36:21.060089 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-538ebb52-9565-42c8-9cac-ea1b74330f67 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:21.070641 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-538ebb52-9565-42c8-9cac-ea1b74330f67 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1259 microversion: 2.1 time: 0.372320 May 23 12:36:21.071525 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 191/379] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:20 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1259 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:21.646095 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-0784c766-d2dc-4583-be11-c001943aacc6 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:21.647119 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-0784c766-d2dc-4583-be11-c001943aacc6 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:21.661183 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0784c766-d2dc-4583-be11-c001943aacc6 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:21.662084 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0784c766-d2dc-4583-be11-c001943aacc6 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:21.664925 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0784c766-d2dc-4583-be11-c001943aacc6 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:21.666926 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0784c766-d2dc-4583-be11-c001943aacc6 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:21.787552 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-78eb13d9-655b-4b1b-89f2-03470410dbbf req-7a4ac641-d5b7-4804-8551-20c79c8e0da2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1acfc6ec-6e8f-4969-99e8-0de456fcb7ed", "tag": "6629f354-c1e7-44f4-90fa-1e340bce002d"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:36:21.808548 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-78eb13d9-655b-4b1b-89f2-03470410dbbf req-7a4ac641-d5b7-4804-8551-20c79c8e0da2 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:21.810549 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-78eb13d9-655b-4b1b-89f2-03470410dbbf req-7a4ac641-d5b7-4804-8551-20c79c8e0da2 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:21.839492 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-78eb13d9-655b-4b1b-89f2-03470410dbbf req-7a4ac641-d5b7-4804-8551-20c79c8e0da2 service nova] Creating event network-changed:6629f354-c1e7-44f4-90fa-1e340bce002d for instance 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed on hv-cinder-83699 May 23 12:36:21.854587 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-78eb13d9-655b-4b1b-89f2-03470410dbbf req-7a4ac641-d5b7-4804-8551-20c79c8e0da2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070154 May 23 12:36:21.855997 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 192/380] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:36:21.983267 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-0784c766-d2dc-4583-be11-c001943aacc6 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:22.001535 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-0784c766-d2dc-4583-be11-c001943aacc6 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f" status: 200 len: 1370 microversion: 2.1 time: 0.359904 May 23 12:36:22.006601 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 189/381] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:21 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f => generated 1370 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:22.071249 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c5d95a0b-7b86-43a3-9f07-b95a202e45c6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:22.071953 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c5d95a0b-7b86-43a3-9f07-b95a202e45c6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:22.078684 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c5d95a0b-7b86-43a3-9f07-b95a202e45c6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:22.079040 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c5d95a0b-7b86-43a3-9f07-b95a202e45c6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:22.079816 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c5d95a0b-7b86-43a3-9f07-b95a202e45c6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:22.080273 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c5d95a0b-7b86-43a3-9f07-b95a202e45c6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:22.087521 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-c8390ca7-3357-4d3b-ba29-31b82d80376d tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:22.088332 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-c8390ca7-3357-4d3b-ba29-31b82d80376d tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:22.094704 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c8390ca7-3357-4d3b-ba29-31b82d80376d tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:22.095443 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c8390ca7-3357-4d3b-ba29-31b82d80376d tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:22.096457 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c8390ca7-3357-4d3b-ba29-31b82d80376d tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:22.097092 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c8390ca7-3357-4d3b-ba29-31b82d80376d tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:22.285514 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c5d95a0b-7b86-43a3-9f07-b95a202e45c6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:22.296020 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c5d95a0b-7b86-43a3-9f07-b95a202e45c6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:22.297879 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c5d95a0b-7b86-43a3-9f07-b95a202e45c6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:22.299322 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c5d95a0b-7b86-43a3-9f07-b95a202e45c6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1810 microversion: 2.20 time: 0.233656 May 23 12:36:22.299918 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 193/382] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:36:22 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1810 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:36:22.321572 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-c8390ca7-3357-4d3b-ba29-31b82d80376d tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:22.330429 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-c8390ca7-3357-4d3b-ba29-31b82d80376d tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1259 microversion: 2.1 time: 0.246625 May 23 12:36:22.331241 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 190/383] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:22 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1259 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:36:23.019184 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-fe4269f4-92c3-48e0-9e9b-d2a31869a8df tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:23.020491 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-fe4269f4-92c3-48e0-9e9b-d2a31869a8df tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:23.027627 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fe4269f4-92c3-48e0-9e9b-d2a31869a8df tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:23.028335 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fe4269f4-92c3-48e0-9e9b-d2a31869a8df tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:23.029353 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fe4269f4-92c3-48e0-9e9b-d2a31869a8df tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:23.029943 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fe4269f4-92c3-48e0-9e9b-d2a31869a8df tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:23.185323 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-fe4269f4-92c3-48e0-9e9b-d2a31869a8df tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:23.193441 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-fe4269f4-92c3-48e0-9e9b-d2a31869a8df tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f" status: 200 len: 1370 microversion: 2.1 time: 0.178467 May 23 12:36:23.194299 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 194/384] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:23 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f => generated 1370 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:23.323144 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-7a81796d-17a8-4f1c-8275-6907e40396dc tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:23.323673 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-7a81796d-17a8-4f1c-8275-6907e40396dc tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:23.330776 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7a81796d-17a8-4f1c-8275-6907e40396dc tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:23.331218 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7a81796d-17a8-4f1c-8275-6907e40396dc tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:23.331985 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7a81796d-17a8-4f1c-8275-6907e40396dc tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:23.332452 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7a81796d-17a8-4f1c-8275-6907e40396dc tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:23.348942 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-22bb6d23-a787-4b52-adb9-8b00922cab73 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:23.350586 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-22bb6d23-a787-4b52-adb9-8b00922cab73 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:23.357919 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-22bb6d23-a787-4b52-adb9-8b00922cab73 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:23.358529 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-22bb6d23-a787-4b52-adb9-8b00922cab73 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:23.359601 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-22bb6d23-a787-4b52-adb9-8b00922cab73 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:23.360296 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-22bb6d23-a787-4b52-adb9-8b00922cab73 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:23.556274 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-7a81796d-17a8-4f1c-8275-6907e40396dc tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:23.567195 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-7a81796d-17a8-4f1c-8275-6907e40396dc tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:23.568737 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-7a81796d-17a8-4f1c-8275-6907e40396dc tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:23.570554 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-7a81796d-17a8-4f1c-8275-6907e40396dc tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1810 microversion: 2.20 time: 0.252497 May 23 12:36:23.583137 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 191/385] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:36:23 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1810 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:36:23.598864 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-22bb6d23-a787-4b52-adb9-8b00922cab73 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:23.607067 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-22bb6d23-a787-4b52-adb9-8b00922cab73 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1259 microversion: 2.1 time: 0.261879 May 23 12:36:23.608042 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 195/386] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:23 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1259 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:36:23.660429 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-0c9e47ca-acc3-4c8e-8481-3e335905701b req-174c18ab-73a1-4053-8d58-c4b8bbfd32c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64486ed1-2721-4c2a-a2fb-a96f3a82f32f", "name": "network-vif-plugged", "status": "completed", "tag": "ccd5bdc8-a41b-4e8c-aebe-0858a605b65b"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:36:23.671249 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-0c9e47ca-acc3-4c8e-8481-3e335905701b req-174c18ab-73a1-4053-8d58-c4b8bbfd32c5 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:23.672468 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-0c9e47ca-acc3-4c8e-8481-3e335905701b req-174c18ab-73a1-4053-8d58-c4b8bbfd32c5 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:23.690358 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-0c9e47ca-acc3-4c8e-8481-3e335905701b req-174c18ab-73a1-4053-8d58-c4b8bbfd32c5 service nova] Creating event network-vif-plugged:ccd5bdc8-a41b-4e8c-aebe-0858a605b65b for instance 64486ed1-2721-4c2a-a2fb-a96f3a82f32f on hv-cinder-83699 May 23 12:36:23.699658 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-0c9e47ca-acc3-4c8e-8481-3e335905701b req-174c18ab-73a1-4053-8d58-c4b8bbfd32c5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043105 May 23 12:36:23.700402 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 192/387] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:36:24.212593 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-6df34fc1-c42c-49f2-b252-1f253177e0a3 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:24.214013 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-6df34fc1-c42c-49f2-b252-1f253177e0a3 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:24.221291 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6df34fc1-c42c-49f2-b252-1f253177e0a3 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:24.221746 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6df34fc1-c42c-49f2-b252-1f253177e0a3 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:24.222693 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6df34fc1-c42c-49f2-b252-1f253177e0a3 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:24.223210 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6df34fc1-c42c-49f2-b252-1f253177e0a3 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:24.365695 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-6df34fc1-c42c-49f2-b252-1f253177e0a3 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:24.373929 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-6df34fc1-c42c-49f2-b252-1f253177e0a3 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f" status: 200 len: 1370 microversion: 2.1 time: 0.166029 May 23 12:36:24.374784 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 196/388] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:24 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f => generated 1370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:24.591178 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-e9ddc071-fb00-4c44-98b6-a59cfa14fda9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:24.591877 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-e9ddc071-fb00-4c44-98b6-a59cfa14fda9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:24.598263 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e9ddc071-fb00-4c44-98b6-a59cfa14fda9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:24.598720 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e9ddc071-fb00-4c44-98b6-a59cfa14fda9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:24.599492 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e9ddc071-fb00-4c44-98b6-a59cfa14fda9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:24.599980 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e9ddc071-fb00-4c44-98b6-a59cfa14fda9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:24.626111 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-93b0fbfb-5052-48ec-aa19-6b066254441a tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:24.626907 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-93b0fbfb-5052-48ec-aa19-6b066254441a tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:24.635144 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-93b0fbfb-5052-48ec-aa19-6b066254441a tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:24.635753 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-93b0fbfb-5052-48ec-aa19-6b066254441a tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:24.636676 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-93b0fbfb-5052-48ec-aa19-6b066254441a tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:24.637234 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-93b0fbfb-5052-48ec-aa19-6b066254441a tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:24.806717 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-e9ddc071-fb00-4c44-98b6-a59cfa14fda9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:24.816032 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-e9ddc071-fb00-4c44-98b6-a59cfa14fda9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:24.817879 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-e9ddc071-fb00-4c44-98b6-a59cfa14fda9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:24.819170 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-e9ddc071-fb00-4c44-98b6-a59cfa14fda9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1810 microversion: 2.20 time: 0.232750 May 23 12:36:24.830933 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 193/389] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:36:24 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1810 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:36:24.839518 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-93b0fbfb-5052-48ec-aa19-6b066254441a tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:24.847918 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-93b0fbfb-5052-48ec-aa19-6b066254441a tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1259 microversion: 2.1 time: 0.225497 May 23 12:36:24.848761 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 197/390] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:24 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1259 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:25.395463 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-2fb41c65-cdaf-4b2c-8d3c-a8fe761cdf28 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:25.396442 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-2fb41c65-cdaf-4b2c-8d3c-a8fe761cdf28 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:25.405693 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2fb41c65-cdaf-4b2c-8d3c-a8fe761cdf28 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:25.406399 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2fb41c65-cdaf-4b2c-8d3c-a8fe761cdf28 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:25.407634 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2fb41c65-cdaf-4b2c-8d3c-a8fe761cdf28 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:25.408352 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2fb41c65-cdaf-4b2c-8d3c-a8fe761cdf28 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:25.594830 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-2fb41c65-cdaf-4b2c-8d3c-a8fe761cdf28 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:25.608520 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-2fb41c65-cdaf-4b2c-8d3c-a8fe761cdf28 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f" status: 200 len: 1370 microversion: 2.1 time: 0.220539 May 23 12:36:25.609794 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 194/391] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:25 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f => generated 1370 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:25.838624 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-fb650d4a-3b34-4dea-929b-d21e036c3bb4 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:25.839307 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-fb650d4a-3b34-4dea-929b-d21e036c3bb4 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:25.846375 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fb650d4a-3b34-4dea-929b-d21e036c3bb4 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:25.847130 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fb650d4a-3b34-4dea-929b-d21e036c3bb4 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:25.848159 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fb650d4a-3b34-4dea-929b-d21e036c3bb4 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:25.848626 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fb650d4a-3b34-4dea-929b-d21e036c3bb4 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:25.869245 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-1ccb2c45-cf9f-4f6f-9bda-4f8454b3a398 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:25.875751 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-1ccb2c45-cf9f-4f6f-9bda-4f8454b3a398 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:25.888107 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1ccb2c45-cf9f-4f6f-9bda-4f8454b3a398 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:25.888565 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1ccb2c45-cf9f-4f6f-9bda-4f8454b3a398 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:25.889367 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1ccb2c45-cf9f-4f6f-9bda-4f8454b3a398 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:25.889813 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1ccb2c45-cf9f-4f6f-9bda-4f8454b3a398 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:26.119040 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-fb650d4a-3b34-4dea-929b-d21e036c3bb4 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:26.128824 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-fb650d4a-3b34-4dea-929b-d21e036c3bb4 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:26.130317 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-fb650d4a-3b34-4dea-929b-d21e036c3bb4 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:26.131192 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-1ccb2c45-cf9f-4f6f-9bda-4f8454b3a398 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:26.131482 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-fb650d4a-3b34-4dea-929b-d21e036c3bb4 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1810 microversion: 2.20 time: 0.297431 May 23 12:36:26.133911 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 198/392] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:36:25 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1810 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:36:26.140423 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-1ccb2c45-cf9f-4f6f-9bda-4f8454b3a398 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1259 microversion: 2.1 time: 0.275630 May 23 12:36:26.141214 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 195/393] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:25 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1259 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:36:26.627796 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-9c68dad5-a28c-4efb-890b-a18257662b6b tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:26.628427 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-9c68dad5-a28c-4efb-890b-a18257662b6b tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:26.635672 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9c68dad5-a28c-4efb-890b-a18257662b6b tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:26.636115 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9c68dad5-a28c-4efb-890b-a18257662b6b tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:26.637028 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9c68dad5-a28c-4efb-890b-a18257662b6b tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:26.637429 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9c68dad5-a28c-4efb-890b-a18257662b6b tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:26.797318 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9c68dad5-a28c-4efb-890b-a18257662b6b tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:26.807680 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-9c68dad5-a28c-4efb-890b-a18257662b6b tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f" status: 200 len: 1370 microversion: 2.1 time: 0.183260 May 23 12:36:26.808755 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 199/394] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:26 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f => generated 1370 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:27.159142 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-43566af5-a196-4da1-add9-8e6225bbb982 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:27.160461 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-43566af5-a196-4da1-add9-8e6225bbb982 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:27.160944 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-1662e58f-b7f0-4b18-9a37-04fbb4ec68c6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:27.162129 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-1662e58f-b7f0-4b18-9a37-04fbb4ec68c6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:27.171855 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-43566af5-a196-4da1-add9-8e6225bbb982 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:27.172325 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-43566af5-a196-4da1-add9-8e6225bbb982 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:27.173115 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-43566af5-a196-4da1-add9-8e6225bbb982 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:27.173545 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-43566af5-a196-4da1-add9-8e6225bbb982 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:27.173731 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1662e58f-b7f0-4b18-9a37-04fbb4ec68c6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:27.174089 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1662e58f-b7f0-4b18-9a37-04fbb4ec68c6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:27.174983 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1662e58f-b7f0-4b18-9a37-04fbb4ec68c6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:27.175434 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1662e58f-b7f0-4b18-9a37-04fbb4ec68c6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:27.394795 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-1662e58f-b7f0-4b18-9a37-04fbb4ec68c6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:27.404113 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-43566af5-a196-4da1-add9-8e6225bbb982 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:27.405913 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-1662e58f-b7f0-4b18-9a37-04fbb4ec68c6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:27.407427 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-1662e58f-b7f0-4b18-9a37-04fbb4ec68c6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:27.408592 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-1662e58f-b7f0-4b18-9a37-04fbb4ec68c6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1810 microversion: 2.20 time: 0.261380 May 23 12:36:27.409140 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 196/395] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:36:27 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1810 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:36:27.411896 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-43566af5-a196-4da1-add9-8e6225bbb982 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1259 microversion: 2.1 time: 0.257067 May 23 12:36:27.412633 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 200/396] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:27 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1259 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:27.830653 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-41bc5e98-62b3-4d91-85b9-1ff5b594cd5a tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:27.831419 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-41bc5e98-62b3-4d91-85b9-1ff5b594cd5a tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:27.838378 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-41bc5e98-62b3-4d91-85b9-1ff5b594cd5a tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:27.838823 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-41bc5e98-62b3-4d91-85b9-1ff5b594cd5a tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:27.839596 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-41bc5e98-62b3-4d91-85b9-1ff5b594cd5a tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:27.840030 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-41bc5e98-62b3-4d91-85b9-1ff5b594cd5a tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:27.986862 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-41bc5e98-62b3-4d91-85b9-1ff5b594cd5a tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:27.994728 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-41bc5e98-62b3-4d91-85b9-1ff5b594cd5a tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f" status: 200 len: 1370 microversion: 2.1 time: 0.168835 May 23 12:36:27.997068 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 197/397] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:27 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f => generated 1370 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:36:28.429387 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0c7fe9e6-d7b9-4b47-b835-39915e447700 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:28.430710 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-0c7fe9e6-d7b9-4b47-b835-39915e447700 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:28.437157 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-45149af4-8679-48b9-ab2d-f02a3b923790 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:28.437829 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0c7fe9e6-d7b9-4b47-b835-39915e447700 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:28.438161 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-45149af4-8679-48b9-ab2d-f02a3b923790 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:28.438509 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0c7fe9e6-d7b9-4b47-b835-39915e447700 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:28.439280 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0c7fe9e6-d7b9-4b47-b835-39915e447700 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:28.439712 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0c7fe9e6-d7b9-4b47-b835-39915e447700 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:28.441491 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell0:SELECT=4 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:36:28.442163 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell0:SELECT=14 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:36:28.453211 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-45149af4-8679-48b9-ab2d-f02a3b923790 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:28.453987 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-45149af4-8679-48b9-ab2d-f02a3b923790 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:28.455126 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-45149af4-8679-48b9-ab2d-f02a3b923790 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:28.455719 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-45149af4-8679-48b9-ab2d-f02a3b923790 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:28.528619 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell0:SELECT=2 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:36:28.658991 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0c7fe9e6-d7b9-4b47-b835-39915e447700 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:28.663312 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-45149af4-8679-48b9-ab2d-f02a3b923790 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:28.667367 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-0c7fe9e6-d7b9-4b47-b835-39915e447700 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1259 microversion: 2.1 time: 0.242524 May 23 12:36:28.673658 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-45149af4-8679-48b9-ab2d-f02a3b923790 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:28.675479 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-45149af4-8679-48b9-ab2d-f02a3b923790 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:28.676962 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-45149af4-8679-48b9-ab2d-f02a3b923790 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1810 microversion: 2.20 time: 0.251829 May 23 12:36:28.677472 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 201/398] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:28 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1259 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:28.679980 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 198/399] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:36:28 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1810 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:36:29.011703 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-a1d08266-c49f-4aee-93b2-1a49ea7ac651 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:29.012362 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-a1d08266-c49f-4aee-93b2-1a49ea7ac651 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:29.017661 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_api:SELECT=84 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:36:29.019582 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a1d08266-c49f-4aee-93b2-1a49ea7ac651 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:29.020102 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a1d08266-c49f-4aee-93b2-1a49ea7ac651 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:29.020911 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a1d08266-c49f-4aee-93b2-1a49ea7ac651 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:29.021340 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a1d08266-c49f-4aee-93b2-1a49ea7ac651 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:29.047763 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:36:29.172552 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-a1d08266-c49f-4aee-93b2-1a49ea7ac651 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:29.181374 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-a1d08266-c49f-4aee-93b2-1a49ea7ac651 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f" status: 200 len: 1370 microversion: 2.1 time: 0.174356 May 23 12:36:29.181956 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 202/400] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:29 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:29.685539 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-57f9975b-058f-4cb5-a10f-2ceacdcc3f6e tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:29.686205 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-57f9975b-058f-4cb5-a10f-2ceacdcc3f6e tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:29.693202 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-57f9975b-058f-4cb5-a10f-2ceacdcc3f6e tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:29.693676 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-57f9975b-058f-4cb5-a10f-2ceacdcc3f6e tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:29.695476 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-57f9975b-058f-4cb5-a10f-2ceacdcc3f6e tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:29.696051 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-57f9975b-058f-4cb5-a10f-2ceacdcc3f6e tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:29.697634 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f440b03d-332c-4503-a83a-865d5b88cc6e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:29.698307 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-f440b03d-332c-4503-a83a-865d5b88cc6e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:29.705093 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f440b03d-332c-4503-a83a-865d5b88cc6e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:29.705755 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f440b03d-332c-4503-a83a-865d5b88cc6e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:29.706540 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f440b03d-332c-4503-a83a-865d5b88cc6e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:29.706977 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f440b03d-332c-4503-a83a-865d5b88cc6e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:29.915921 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-57f9975b-058f-4cb5-a10f-2ceacdcc3f6e tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:29.923554 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f440b03d-332c-4503-a83a-865d5b88cc6e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:29.924904 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-57f9975b-058f-4cb5-a10f-2ceacdcc3f6e tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1259 microversion: 2.1 time: 0.243183 May 23 12:36:29.934067 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f440b03d-332c-4503-a83a-865d5b88cc6e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:29.935588 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f440b03d-332c-4503-a83a-865d5b88cc6e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:29.935921 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 199/401] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:29 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1259 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:29.936779 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f440b03d-332c-4503-a83a-865d5b88cc6e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1810 microversion: 2.20 time: 0.244464 May 23 12:36:29.937463 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 203/402] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:36:29 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1810 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:36:30.199248 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-311a5c53-50a9-48d6-b3c9-9b6eac47b227 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:30.199853 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-311a5c53-50a9-48d6-b3c9-9b6eac47b227 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:30.206188 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-311a5c53-50a9-48d6-b3c9-9b6eac47b227 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:30.206638 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-311a5c53-50a9-48d6-b3c9-9b6eac47b227 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:30.207408 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-311a5c53-50a9-48d6-b3c9-9b6eac47b227 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:30.207841 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-311a5c53-50a9-48d6-b3c9-9b6eac47b227 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:30.348135 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-311a5c53-50a9-48d6-b3c9-9b6eac47b227 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:30.350368 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:36:30.357467 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-311a5c53-50a9-48d6-b3c9-9b6eac47b227 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f" status: 200 len: 1370 microversion: 2.1 time: 0.162500 May 23 12:36:30.358240 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 200/403] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:30 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:30.946857 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-02259a5e-f12a-421d-984e-955a38a4d05f tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:30.947545 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-02259a5e-f12a-421d-984e-955a38a4d05f tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:30.955246 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-02259a5e-f12a-421d-984e-955a38a4d05f tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:30.955702 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-02259a5e-f12a-421d-984e-955a38a4d05f tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:30.956368 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-dfe4479b-fa26-4659-8d2b-31d0c12e43a9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:30.956881 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-02259a5e-f12a-421d-984e-955a38a4d05f tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:30.956982 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-dfe4479b-fa26-4659-8d2b-31d0c12e43a9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:30.957204 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-02259a5e-f12a-421d-984e-955a38a4d05f tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:30.964912 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-dfe4479b-fa26-4659-8d2b-31d0c12e43a9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:30.965420 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-dfe4479b-fa26-4659-8d2b-31d0c12e43a9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:30.966152 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-dfe4479b-fa26-4659-8d2b-31d0c12e43a9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:30.966592 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-dfe4479b-fa26-4659-8d2b-31d0c12e43a9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:31.181225 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-02259a5e-f12a-421d-984e-955a38a4d05f tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:31.189829 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-02259a5e-f12a-421d-984e-955a38a4d05f tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1259 microversion: 2.1 time: 0.246731 May 23 12:36:31.190523 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 204/404] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:30 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1259 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:31.203587 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-dfe4479b-fa26-4659-8d2b-31d0c12e43a9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:31.213210 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-dfe4479b-fa26-4659-8d2b-31d0c12e43a9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:31.214864 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-dfe4479b-fa26-4659-8d2b-31d0c12e43a9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:31.216037 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-dfe4479b-fa26-4659-8d2b-31d0c12e43a9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1810 microversion: 2.20 time: 0.265218 May 23 12:36:31.216618 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 201/405] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:36:30 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1810 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:36:31.374534 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c915c09e-40b8-41df-a8d3-698803405553 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:31.375143 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c915c09e-40b8-41df-a8d3-698803405553 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:31.381485 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c915c09e-40b8-41df-a8d3-698803405553 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:31.382398 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c915c09e-40b8-41df-a8d3-698803405553 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:31.383540 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c915c09e-40b8-41df-a8d3-698803405553 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:31.383976 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c915c09e-40b8-41df-a8d3-698803405553 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:31.519153 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c915c09e-40b8-41df-a8d3-698803405553 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:31.527229 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c915c09e-40b8-41df-a8d3-698803405553 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f" status: 200 len: 1370 microversion: 2.1 time: 0.156583 May 23 12:36:31.527782 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 205/406] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:31 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:32.208489 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-fda48810-a765-41f2-822e-b820706bd745 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:32.209152 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-fda48810-a765-41f2-822e-b820706bd745 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:32.215743 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-fda48810-a765-41f2-822e-b820706bd745 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:32.216223 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-fda48810-a765-41f2-822e-b820706bd745 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:32.216990 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-fda48810-a765-41f2-822e-b820706bd745 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:32.217426 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-fda48810-a765-41f2-822e-b820706bd745 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:32.235869 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-a25233b8-959e-47ea-8ffc-280a573d854c tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:32.236627 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-a25233b8-959e-47ea-8ffc-280a573d854c tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:32.243731 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a25233b8-959e-47ea-8ffc-280a573d854c tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:32.244199 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a25233b8-959e-47ea-8ffc-280a573d854c tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:32.244977 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a25233b8-959e-47ea-8ffc-280a573d854c tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:32.245412 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a25233b8-959e-47ea-8ffc-280a573d854c tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:32.419517 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-fda48810-a765-41f2-822e-b820706bd745 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:32.426543 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-a25233b8-959e-47ea-8ffc-280a573d854c tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:32.427178 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-fda48810-a765-41f2-822e-b820706bd745 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1259 microversion: 2.1 time: 0.222570 May 23 12:36:32.427746 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 202/407] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:32 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1259 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:32.435192 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-a25233b8-959e-47ea-8ffc-280a573d854c tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:32.436710 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-a25233b8-959e-47ea-8ffc-280a573d854c tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:32.437860 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-a25233b8-959e-47ea-8ffc-280a573d854c tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1810 microversion: 2.20 time: 0.205899 May 23 12:36:32.438405 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 206/408] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:36:32 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1810 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:36:32.543403 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-83e16029-35e4-48b6-b3b0-258debc5867f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:32.544038 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-83e16029-35e4-48b6-b3b0-258debc5867f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:32.550066 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-83e16029-35e4-48b6-b3b0-258debc5867f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:32.550517 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-83e16029-35e4-48b6-b3b0-258debc5867f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:32.551279 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-83e16029-35e4-48b6-b3b0-258debc5867f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:32.551716 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-83e16029-35e4-48b6-b3b0-258debc5867f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:32.738309 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-83e16029-35e4-48b6-b3b0-258debc5867f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:32.749373 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-83e16029-35e4-48b6-b3b0-258debc5867f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f" status: 200 len: 1370 microversion: 2.1 time: 0.210344 May 23 12:36:32.759247 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 203/409] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:32 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f => generated 1370 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:33.443953 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f6808254-e7bd-407c-bf09-ae3519618b06 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:33.444578 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-f6808254-e7bd-407c-bf09-ae3519618b06 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:33.452383 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f6808254-e7bd-407c-bf09-ae3519618b06 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:33.452830 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f6808254-e7bd-407c-bf09-ae3519618b06 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:33.453587 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f6808254-e7bd-407c-bf09-ae3519618b06 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:33.454018 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f6808254-e7bd-407c-bf09-ae3519618b06 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:33.456399 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-0f81123e-483f-40cf-ac62-b943c8046a05 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:33.457006 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-0f81123e-483f-40cf-ac62-b943c8046a05 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:33.463559 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0f81123e-483f-40cf-ac62-b943c8046a05 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:33.464069 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0f81123e-483f-40cf-ac62-b943c8046a05 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:33.465147 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0f81123e-483f-40cf-ac62-b943c8046a05 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:33.465645 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0f81123e-483f-40cf-ac62-b943c8046a05 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:33.950884 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f6808254-e7bd-407c-bf09-ae3519618b06 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:33.953967 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-0f81123e-483f-40cf-ac62-b943c8046a05 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:33.958789 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f6808254-e7bd-407c-bf09-ae3519618b06 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1259 microversion: 2.1 time: 0.518580 May 23 12:36:33.959373 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 207/410] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:33 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1259 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:33.963632 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-0f81123e-483f-40cf-ac62-b943c8046a05 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:33.964419 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-51e1a622-3e94-46bb-99dc-c11af6c7b5b5 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:33.965401 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-0f81123e-483f-40cf-ac62-b943c8046a05 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:33.965680 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-51e1a622-3e94-46bb-99dc-c11af6c7b5b5 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:33.966563 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-0f81123e-483f-40cf-ac62-b943c8046a05 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1810 microversion: 2.20 time: 0.514283 May 23 12:36:33.967638 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 204/411] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:36:33 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1810 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:36:33.972257 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-51e1a622-3e94-46bb-99dc-c11af6c7b5b5 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:33.972765 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-51e1a622-3e94-46bb-99dc-c11af6c7b5b5 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:33.973725 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-51e1a622-3e94-46bb-99dc-c11af6c7b5b5 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:33.974170 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-51e1a622-3e94-46bb-99dc-c11af6c7b5b5 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:34.104264 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-51e1a622-3e94-46bb-99dc-c11af6c7b5b5 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:34.111967 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-51e1a622-3e94-46bb-99dc-c11af6c7b5b5 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f" status: 200 len: 1370 microversion: 2.1 time: 0.151576 May 23 12:36:34.112631 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 208/412] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:33 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:34.982183 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-8485349f-089d-4bdd-a07b-23cdc8bdee0b tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:34.983073 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-8485349f-089d-4bdd-a07b-23cdc8bdee0b tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:34.988205 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-40b7da2d-7c23-4a0a-b9d4-b15f7134d928 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:34.989437 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-40b7da2d-7c23-4a0a-b9d4-b15f7134d928 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:34.989573 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8485349f-089d-4bdd-a07b-23cdc8bdee0b tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:34.989906 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8485349f-089d-4bdd-a07b-23cdc8bdee0b tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:34.990675 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8485349f-089d-4bdd-a07b-23cdc8bdee0b tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:34.991104 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8485349f-089d-4bdd-a07b-23cdc8bdee0b tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:34.997883 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-40b7da2d-7c23-4a0a-b9d4-b15f7134d928 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:34.998399 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-40b7da2d-7c23-4a0a-b9d4-b15f7134d928 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:34.999336 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-40b7da2d-7c23-4a0a-b9d4-b15f7134d928 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:34.999781 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-40b7da2d-7c23-4a0a-b9d4-b15f7134d928 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:35.195482 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-8485349f-089d-4bdd-a07b-23cdc8bdee0b tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:35.199580 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-40b7da2d-7c23-4a0a-b9d4-b15f7134d928 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:35.203287 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-8485349f-089d-4bdd-a07b-23cdc8bdee0b tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1259 microversion: 2.1 time: 0.225171 May 23 12:36:35.203911 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 205/413] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:34 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1259 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:35.208374 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-8cc41d5c-f959-4422-94fe-ea95c8a8d010 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:35.208599 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-40b7da2d-7c23-4a0a-b9d4-b15f7134d928 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:35.208975 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-8cc41d5c-f959-4422-94fe-ea95c8a8d010 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:35.210039 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-40b7da2d-7c23-4a0a-b9d4-b15f7134d928 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:35.211186 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-40b7da2d-7c23-4a0a-b9d4-b15f7134d928 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1810 microversion: 2.20 time: 0.226878 May 23 12:36:35.212799 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 209/414] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:36:34 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1810 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:36:35.215320 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8cc41d5c-f959-4422-94fe-ea95c8a8d010 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:35.215771 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8cc41d5c-f959-4422-94fe-ea95c8a8d010 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:35.216568 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8cc41d5c-f959-4422-94fe-ea95c8a8d010 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:35.217005 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8cc41d5c-f959-4422-94fe-ea95c8a8d010 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:35.346343 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-8cc41d5c-f959-4422-94fe-ea95c8a8d010 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:35.354251 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-8cc41d5c-f959-4422-94fe-ea95c8a8d010 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f" status: 200 len: 1565 microversion: 2.1 time: 0.149316 May 23 12:36:35.354818 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 206/415] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:35 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f => generated 1565 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:35.370130 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c479f376-99cb-4e40-ac83-5808ee8e5382 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:35.370624 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c479f376-99cb-4e40-ac83-5808ee8e5382 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:35.376646 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c479f376-99cb-4e40-ac83-5808ee8e5382 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:35.377094 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c479f376-99cb-4e40-ac83-5808ee8e5382 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:35.377902 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c479f376-99cb-4e40-ac83-5808ee8e5382 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:35.378324 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c479f376-99cb-4e40-ac83-5808ee8e5382 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:35.458777 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c479f376-99cb-4e40-ac83-5808ee8e5382 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092370 May 23 12:36:35.459366 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 210/416] 10.222.0.16 () {58 vars in 1274 bytes} [Mon May 23 12:36:35 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:36:36.220013 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-54fbd487-efe1-45e8-93f7-4d0f8d267fcc tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:36.220661 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-54fbd487-efe1-45e8-93f7-4d0f8d267fcc tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:36.228219 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-54fbd487-efe1-45e8-93f7-4d0f8d267fcc tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:36.229049 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-54fbd487-efe1-45e8-93f7-4d0f8d267fcc tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:36.229711 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-54fbd487-efe1-45e8-93f7-4d0f8d267fcc tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:36.230162 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-54fbd487-efe1-45e8-93f7-4d0f8d267fcc tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:36.231081 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b7d77cfa-f899-414c-aa18-a78d15ce2634 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:36.231691 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-b7d77cfa-f899-414c-aa18-a78d15ce2634 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:36.237930 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b7d77cfa-f899-414c-aa18-a78d15ce2634 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:36.238371 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b7d77cfa-f899-414c-aa18-a78d15ce2634 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:36.239137 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b7d77cfa-f899-414c-aa18-a78d15ce2634 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:36.239749 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b7d77cfa-f899-414c-aa18-a78d15ce2634 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:36.541056 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-54fbd487-efe1-45e8-93f7-4d0f8d267fcc tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:36.548219 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b7d77cfa-f899-414c-aa18-a78d15ce2634 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:36.548785 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-54fbd487-efe1-45e8-93f7-4d0f8d267fcc tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1259 microversion: 2.1 time: 0.332601 May 23 12:36:36.551942 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 207/417] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:36 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1259 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:36.557778 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b7d77cfa-f899-414c-aa18-a78d15ce2634 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:36.559273 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b7d77cfa-f899-414c-aa18-a78d15ce2634 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:36.560464 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b7d77cfa-f899-414c-aa18-a78d15ce2634 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1810 microversion: 2.20 time: 0.334471 May 23 12:36:36.561014 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 211/418] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:36:36 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1810 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:36:36.714478 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-da560f1c-ee5e-4d06-990c-555448ce7a06 req-1c891a7b-278e-4043-bf47-1a6bf0c2c701 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64486ed1-2721-4c2a-a2fb-a96f3a82f32f", "tag": "ccd5bdc8-a41b-4e8c-aebe-0858a605b65b"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:36:36.722671 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-da560f1c-ee5e-4d06-990c-555448ce7a06 req-1c891a7b-278e-4043-bf47-1a6bf0c2c701 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:36.723119 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-da560f1c-ee5e-4d06-990c-555448ce7a06 req-1c891a7b-278e-4043-bf47-1a6bf0c2c701 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:36.735081 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-da560f1c-ee5e-4d06-990c-555448ce7a06 req-1c891a7b-278e-4043-bf47-1a6bf0c2c701 service nova] Creating event network-changed:ccd5bdc8-a41b-4e8c-aebe-0858a605b65b for instance 64486ed1-2721-4c2a-a2fb-a96f3a82f32f on hv-cinder-83699 May 23 12:36:36.740116 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-da560f1c-ee5e-4d06-990c-555448ce7a06 req-1c891a7b-278e-4043-bf47-1a6bf0c2c701 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029830 May 23 12:36:36.740998 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 208/419] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:36:37.566151 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-e4c5ab9d-ac9f-4afe-81e0-2ab69264a13e tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:37.566908 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-e4c5ab9d-ac9f-4afe-81e0-2ab69264a13e tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:37.575511 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e4c5ab9d-ac9f-4afe-81e0-2ab69264a13e tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:37.576033 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e4c5ab9d-ac9f-4afe-81e0-2ab69264a13e tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:37.577097 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e4c5ab9d-ac9f-4afe-81e0-2ab69264a13e tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:37.577534 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e4c5ab9d-ac9f-4afe-81e0-2ab69264a13e tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:37.580789 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-0ef3d9a2-0824-45e2-9afc-fa62013ee927 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:37.581769 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-0ef3d9a2-0824-45e2-9afc-fa62013ee927 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:37.588879 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0ef3d9a2-0824-45e2-9afc-fa62013ee927 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:37.589453 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0ef3d9a2-0824-45e2-9afc-fa62013ee927 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:37.590228 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0ef3d9a2-0824-45e2-9afc-fa62013ee927 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:37.590786 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0ef3d9a2-0824-45e2-9afc-fa62013ee927 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:37.794445 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-e4c5ab9d-ac9f-4afe-81e0-2ab69264a13e tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:37.797444 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-0ef3d9a2-0824-45e2-9afc-fa62013ee927 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:37.802685 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-e4c5ab9d-ac9f-4afe-81e0-2ab69264a13e tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1259 microversion: 2.1 time: 0.240078 May 23 12:36:37.803239 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 212/420] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:37 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1259 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:37.807233 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-0ef3d9a2-0824-45e2-9afc-fa62013ee927 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:37.808775 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-0ef3d9a2-0824-45e2-9afc-fa62013ee927 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:37.809967 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-0ef3d9a2-0824-45e2-9afc-fa62013ee927 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1810 microversion: 2.20 time: 0.234104 May 23 12:36:37.810708 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 209/421] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:36:37 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1810 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:36:38.818883 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-1aade33b-abaa-4859-88f4-d9a980580415 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:38.819491 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-1aade33b-abaa-4859-88f4-d9a980580415 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:38.827115 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1aade33b-abaa-4859-88f4-d9a980580415 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:38.827569 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1aade33b-abaa-4859-88f4-d9a980580415 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:38.828312 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-a50b4190-a2c0-43f2-8ffb-26abad4e68e5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:38.828853 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1aade33b-abaa-4859-88f4-d9a980580415 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:38.828853 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1aade33b-abaa-4859-88f4-d9a980580415 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:38.829044 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-a50b4190-a2c0-43f2-8ffb-26abad4e68e5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:38.831476 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:36:38.837445 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a50b4190-a2c0-43f2-8ffb-26abad4e68e5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:38.837895 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a50b4190-a2c0-43f2-8ffb-26abad4e68e5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:38.838670 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a50b4190-a2c0-43f2-8ffb-26abad4e68e5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:38.839110 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a50b4190-a2c0-43f2-8ffb-26abad4e68e5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:39.026741 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1aade33b-abaa-4859-88f4-d9a980580415 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:39.033895 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-1aade33b-abaa-4859-88f4-d9a980580415 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1259 microversion: 2.1 time: 0.218804 May 23 12:36:39.034474 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 213/422] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:38 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1259 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:39.034611 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-a50b4190-a2c0-43f2-8ffb-26abad4e68e5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:39.043893 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-a50b4190-a2c0-43f2-8ffb-26abad4e68e5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:39.045417 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-a50b4190-a2c0-43f2-8ffb-26abad4e68e5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:39.046581 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-a50b4190-a2c0-43f2-8ffb-26abad4e68e5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1810 microversion: 2.20 time: 0.222439 May 23 12:36:39.047124 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 210/423] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:36:38 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1810 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:36:40.050659 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-548f21b1-d47f-4b85-8e62-d98c2d2bc50a tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:40.051264 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-548f21b1-d47f-4b85-8e62-d98c2d2bc50a tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:40.057852 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-548f21b1-d47f-4b85-8e62-d98c2d2bc50a tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:40.058327 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-548f21b1-d47f-4b85-8e62-d98c2d2bc50a tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:40.059086 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-548f21b1-d47f-4b85-8e62-d98c2d2bc50a tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:40.059518 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-548f21b1-d47f-4b85-8e62-d98c2d2bc50a tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:40.071227 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-6f09f5c1-d38a-48e4-86f6-bb7ab96b0458 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:40.071991 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-6f09f5c1-d38a-48e4-86f6-bb7ab96b0458 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:40.079130 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6f09f5c1-d38a-48e4-86f6-bb7ab96b0458 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:40.079581 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6f09f5c1-d38a-48e4-86f6-bb7ab96b0458 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:40.080414 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6f09f5c1-d38a-48e4-86f6-bb7ab96b0458 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:40.080854 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6f09f5c1-d38a-48e4-86f6-bb7ab96b0458 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:40.262795 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-548f21b1-d47f-4b85-8e62-d98c2d2bc50a tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:40.267901 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-6f09f5c1-d38a-48e4-86f6-bb7ab96b0458 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:40.270344 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-548f21b1-d47f-4b85-8e62-d98c2d2bc50a tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1259 microversion: 2.1 time: 0.223503 May 23 12:36:40.270913 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 214/424] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:40 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1259 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:40.276565 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-6f09f5c1-d38a-48e4-86f6-bb7ab96b0458 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:40.278070 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-6f09f5c1-d38a-48e4-86f6-bb7ab96b0458 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:40.279217 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-6f09f5c1-d38a-48e4-86f6-bb7ab96b0458 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1810 microversion: 2.20 time: 0.212442 May 23 12:36:40.279758 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 211/425] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:36:40 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1810 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:36:41.287543 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-3330bf89-b7c9-46a8-b143-08877c599993 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:41.288096 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-3330bf89-b7c9-46a8-b143-08877c599993 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:41.295686 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3330bf89-b7c9-46a8-b143-08877c599993 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:41.296136 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3330bf89-b7c9-46a8-b143-08877c599993 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:41.296946 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3330bf89-b7c9-46a8-b143-08877c599993 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:41.297049 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-c3511fec-a66b-47aa-8a59-b1f63de83486 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:41.297489 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3330bf89-b7c9-46a8-b143-08877c599993 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:41.297658 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-c3511fec-a66b-47aa-8a59-b1f63de83486 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:41.304294 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c3511fec-a66b-47aa-8a59-b1f63de83486 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:41.304751 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c3511fec-a66b-47aa-8a59-b1f63de83486 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:41.306028 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c3511fec-a66b-47aa-8a59-b1f63de83486 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:41.306464 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c3511fec-a66b-47aa-8a59-b1f63de83486 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:41.507329 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-3330bf89-b7c9-46a8-b143-08877c599993 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:41.511153 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-c3511fec-a66b-47aa-8a59-b1f63de83486 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:41.516151 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-3330bf89-b7c9-46a8-b143-08877c599993 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1259 microversion: 2.1 time: 0.232442 May 23 12:36:41.524558 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 215/426] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:41 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1259 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:41.524764 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-c3511fec-a66b-47aa-8a59-b1f63de83486 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:41.524764 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-c3511fec-a66b-47aa-8a59-b1f63de83486 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:41.525080 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-c3511fec-a66b-47aa-8a59-b1f63de83486 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1810 microversion: 2.20 time: 0.231269 May 23 12:36:41.526035 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 212/427] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:36:41 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1810 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:36:42.532998 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-556a853c-9b0d-41c0-8293-1c61ad112b07 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:42.533601 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-556a853c-9b0d-41c0-8293-1c61ad112b07 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:42.541293 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-556a853c-9b0d-41c0-8293-1c61ad112b07 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:42.541744 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-556a853c-9b0d-41c0-8293-1c61ad112b07 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:42.542528 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-556a853c-9b0d-41c0-8293-1c61ad112b07 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:42.542963 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-556a853c-9b0d-41c0-8293-1c61ad112b07 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:42.545440 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-c4a73b5c-0471-448e-b608-d9356b5eea50 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:42.546220 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-c4a73b5c-0471-448e-b608-d9356b5eea50 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:42.552801 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c4a73b5c-0471-448e-b608-d9356b5eea50 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:42.553243 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c4a73b5c-0471-448e-b608-d9356b5eea50 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:42.554018 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c4a73b5c-0471-448e-b608-d9356b5eea50 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:42.554449 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c4a73b5c-0471-448e-b608-d9356b5eea50 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:42.758203 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-556a853c-9b0d-41c0-8293-1c61ad112b07 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:42.765683 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-c4a73b5c-0471-448e-b608-d9356b5eea50 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:42.766529 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-556a853c-9b0d-41c0-8293-1c61ad112b07 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1259 microversion: 2.1 time: 0.237312 May 23 12:36:42.767207 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 216/428] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:42 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1259 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:42.775100 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-c4a73b5c-0471-448e-b608-d9356b5eea50 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:42.776624 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-c4a73b5c-0471-448e-b608-d9356b5eea50 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:42.777774 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-c4a73b5c-0471-448e-b608-d9356b5eea50 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1810 microversion: 2.20 time: 0.236540 May 23 12:36:42.778334 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 213/429] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:36:42 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1810 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:36:43.784914 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-906f5228-c58f-4ff2-b877-b7076d20bc1f tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:43.785476 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-906f5228-c58f-4ff2-b877-b7076d20bc1f tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:43.792473 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-906f5228-c58f-4ff2-b877-b7076d20bc1f tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:43.792921 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-906f5228-c58f-4ff2-b877-b7076d20bc1f tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:43.793691 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-906f5228-c58f-4ff2-b877-b7076d20bc1f tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:43.794122 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-906f5228-c58f-4ff2-b877-b7076d20bc1f tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:43.795972 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-759a11f2-c1b1-4db6-91d8-0d76998cf8c0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:43.797168 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-759a11f2-c1b1-4db6-91d8-0d76998cf8c0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:43.803974 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-759a11f2-c1b1-4db6-91d8-0d76998cf8c0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:43.804452 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-759a11f2-c1b1-4db6-91d8-0d76998cf8c0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:43.805306 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-759a11f2-c1b1-4db6-91d8-0d76998cf8c0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:43.805745 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-759a11f2-c1b1-4db6-91d8-0d76998cf8c0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:44.011437 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-759a11f2-c1b1-4db6-91d8-0d76998cf8c0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:44.025219 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-906f5228-c58f-4ff2-b877-b7076d20bc1f tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:44.032071 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-759a11f2-c1b1-4db6-91d8-0d76998cf8c0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:44.034756 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-759a11f2-c1b1-4db6-91d8-0d76998cf8c0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:44.036190 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-906f5228-c58f-4ff2-b877-b7076d20bc1f tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1259 microversion: 2.1 time: 0.254773 May 23 12:36:44.036858 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-759a11f2-c1b1-4db6-91d8-0d76998cf8c0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1810 microversion: 2.20 time: 0.244775 May 23 12:36:44.036992 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 217/430] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:43 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1259 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:44.042947 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-1018ae57-ed7e-44a4-82c4-302aa30bc2cd req-c9f400b5-a173-42c5-988b-a663343fb06a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce37af9c-e5f8-4233-97f3-4280a2114e45", "name": "network-vif-plugged", "status": "completed", "tag": "357ce430-3b90-4a7c-b2f3-c2ee303501e4"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:36:44.048764 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 214/431] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:36:43 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1810 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:36:44.052232 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-1018ae57-ed7e-44a4-82c4-302aa30bc2cd req-c9f400b5-a173-42c5-988b-a663343fb06a service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:44.052694 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-1018ae57-ed7e-44a4-82c4-302aa30bc2cd req-c9f400b5-a173-42c5-988b-a663343fb06a service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:44.063891 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-1018ae57-ed7e-44a4-82c4-302aa30bc2cd req-c9f400b5-a173-42c5-988b-a663343fb06a service nova] Creating event network-vif-plugged:357ce430-3b90-4a7c-b2f3-c2ee303501e4 for instance ce37af9c-e5f8-4233-97f3-4280a2114e45 on hv-cinder-83699 May 23 12:36:44.069264 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-1018ae57-ed7e-44a4-82c4-302aa30bc2cd req-c9f400b5-a173-42c5-988b-a663343fb06a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031162 May 23 12:36:44.070306 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 218/432] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:36:45.054135 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-53249313-82bc-4d2b-88ac-61e43d97bbb8 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:45.054855 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-53249313-82bc-4d2b-88ac-61e43d97bbb8 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:45.056716 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-be287967-6e03-4248-81bf-8c1b921876ab tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:45.057414 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-be287967-6e03-4248-81bf-8c1b921876ab tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:45.062395 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-53249313-82bc-4d2b-88ac-61e43d97bbb8 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:45.062848 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-53249313-82bc-4d2b-88ac-61e43d97bbb8 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:45.063684 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-53249313-82bc-4d2b-88ac-61e43d97bbb8 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:45.064117 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-be287967-6e03-4248-81bf-8c1b921876ab tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:45.064243 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-53249313-82bc-4d2b-88ac-61e43d97bbb8 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:45.064623 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-be287967-6e03-4248-81bf-8c1b921876ab tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:45.065393 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-be287967-6e03-4248-81bf-8c1b921876ab tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:45.065826 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-be287967-6e03-4248-81bf-8c1b921876ab tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:45.257308 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-53249313-82bc-4d2b-88ac-61e43d97bbb8 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:45.261605 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-be287967-6e03-4248-81bf-8c1b921876ab tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:45.264982 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-53249313-82bc-4d2b-88ac-61e43d97bbb8 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1259 microversion: 2.1 time: 0.214624 May 23 12:36:45.265555 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 215/433] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:45 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1259 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:45.270054 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-be287967-6e03-4248-81bf-8c1b921876ab tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:45.271544 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-be287967-6e03-4248-81bf-8c1b921876ab tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:45.272750 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-be287967-6e03-4248-81bf-8c1b921876ab tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1810 microversion: 2.20 time: 0.221008 May 23 12:36:45.273289 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 219/434] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:36:45 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1810 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:36:45.537525 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 12:36:45.537918 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Mon May 23 12:36:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 12:36:46.085087 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-901fb8ec-394d-4fef-8afe-e15d1277b9d7 req-6e04f043-385d-49f6-bc84-28e5a071f9e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1acfc6ec-6e8f-4969-99e8-0de456fcb7ed", "name": "network-vif-plugged", "status": "completed", "tag": "6629f354-c1e7-44f4-90fa-1e340bce002d"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:36:46.094411 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-901fb8ec-394d-4fef-8afe-e15d1277b9d7 req-6e04f043-385d-49f6-bc84-28e5a071f9e1 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:46.094853 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-901fb8ec-394d-4fef-8afe-e15d1277b9d7 req-6e04f043-385d-49f6-bc84-28e5a071f9e1 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:46.105666 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-901fb8ec-394d-4fef-8afe-e15d1277b9d7 req-6e04f043-385d-49f6-bc84-28e5a071f9e1 service nova] Creating event network-vif-plugged:6629f354-c1e7-44f4-90fa-1e340bce002d for instance 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed on hv-cinder-83699 May 23 12:36:46.110601 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-901fb8ec-394d-4fef-8afe-e15d1277b9d7 req-6e04f043-385d-49f6-bc84-28e5a071f9e1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029181 May 23 12:36:46.111166 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 216/435] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:36:46.282069 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-1e035925-fa15-4d17-aeb5-c2da51f86b91 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:46.282604 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-1e035925-fa15-4d17-aeb5-c2da51f86b91 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:46.289116 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1e035925-fa15-4d17-aeb5-c2da51f86b91 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:46.289644 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1e035925-fa15-4d17-aeb5-c2da51f86b91 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:46.290720 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1e035925-fa15-4d17-aeb5-c2da51f86b91 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:46.291153 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1e035925-fa15-4d17-aeb5-c2da51f86b91 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:46.291336 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-2d021903-c390-4cb5-8a36-a41eec61b244 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:46.292037 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-2d021903-c390-4cb5-8a36-a41eec61b244 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:46.293780 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell1:SELECT=100 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:36:46.298312 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2d021903-c390-4cb5-8a36-a41eec61b244 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:46.298770 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2d021903-c390-4cb5-8a36-a41eec61b244 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:46.299547 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2d021903-c390-4cb5-8a36-a41eec61b244 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:46.299988 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2d021903-c390-4cb5-8a36-a41eec61b244 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:46.494206 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1e035925-fa15-4d17-aeb5-c2da51f86b91 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:46.498053 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-2d021903-c390-4cb5-8a36-a41eec61b244 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:46.502358 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-1e035925-fa15-4d17-aeb5-c2da51f86b91 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1259 microversion: 2.1 time: 0.224174 May 23 12:36:46.503296 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 220/436] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:46 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1259 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:46.510181 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-2d021903-c390-4cb5-8a36-a41eec61b244 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:46.512382 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-2d021903-c390-4cb5-8a36-a41eec61b244 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:46.513590 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-2d021903-c390-4cb5-8a36-a41eec61b244 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1810 microversion: 2.20 time: 0.226605 May 23 12:36:46.514121 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 217/437] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:36:46 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1810 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:36:47.520743 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-ec1a4e9c-cfe2-4818-a2e6-31cd57250089 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:47.521372 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-ec1a4e9c-cfe2-4818-a2e6-31cd57250089 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:47.528652 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ec1a4e9c-cfe2-4818-a2e6-31cd57250089 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:47.529106 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ec1a4e9c-cfe2-4818-a2e6-31cd57250089 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:47.529887 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ec1a4e9c-cfe2-4818-a2e6-31cd57250089 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:47.530328 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ec1a4e9c-cfe2-4818-a2e6-31cd57250089 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:47.531580 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-4390c252-1c23-4c1f-8d52-cb15aa5a4797 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:47.532597 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-4390c252-1c23-4c1f-8d52-cb15aa5a4797 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:47.539332 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4390c252-1c23-4c1f-8d52-cb15aa5a4797 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:47.539960 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4390c252-1c23-4c1f-8d52-cb15aa5a4797 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:47.540913 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4390c252-1c23-4c1f-8d52-cb15aa5a4797 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:47.541352 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4390c252-1c23-4c1f-8d52-cb15aa5a4797 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:47.734929 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-ec1a4e9c-cfe2-4818-a2e6-31cd57250089 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:47.737816 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-4390c252-1c23-4c1f-8d52-cb15aa5a4797 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:47.740099 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell1:SELECT=100 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:36:47.744061 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-ec1a4e9c-cfe2-4818-a2e6-31cd57250089 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1259 microversion: 2.1 time: 0.227138 May 23 12:36:47.744681 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 221/438] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:47 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1259 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:47.748239 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-4390c252-1c23-4c1f-8d52-cb15aa5a4797 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:47.749744 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-4390c252-1c23-4c1f-8d52-cb15aa5a4797 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:47.750893 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-4390c252-1c23-4c1f-8d52-cb15aa5a4797 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1797 microversion: 2.20 time: 0.223313 May 23 12:36:47.751438 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 218/439] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:36:47 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1797 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:36:48.762670 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-641f9ec5-f8fb-448b-827b-8a340a43b466 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:48.763191 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-641f9ec5-f8fb-448b-827b-8a340a43b466 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:48.769869 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-641f9ec5-f8fb-448b-827b-8a340a43b466 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:48.770373 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-641f9ec5-f8fb-448b-827b-8a340a43b466 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:48.771179 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-641f9ec5-f8fb-448b-827b-8a340a43b466 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:48.771608 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-641f9ec5-f8fb-448b-827b-8a340a43b466 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:48.906861 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-641f9ec5-f8fb-448b-827b-8a340a43b466 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:48.914806 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-641f9ec5-f8fb-448b-827b-8a340a43b466 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1443 microversion: 2.1 time: 0.157175 May 23 12:36:48.915731 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 222/440] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:48 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1443 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:48.932301 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-b0078b2f-4b02-4b64-b558-9eb366a66e4f tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:48.932905 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-b0078b2f-4b02-4b64-b558-9eb366a66e4f tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:48.939379 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b0078b2f-4b02-4b64-b558-9eb366a66e4f tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:48.939822 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b0078b2f-4b02-4b64-b558-9eb366a66e4f tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:48.940612 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b0078b2f-4b02-4b64-b558-9eb366a66e4f tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:48.941046 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b0078b2f-4b02-4b64-b558-9eb366a66e4f tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:49.072091 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-b0078b2f-4b02-4b64-b558-9eb366a66e4f tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:49.080071 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-b0078b2f-4b02-4b64-b558-9eb366a66e4f tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1443 microversion: 2.1 time: 0.152478 May 23 12:36:49.080678 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 219/441] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:48 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1443 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:50.890236 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-d6d81020-795b-4348-aff8-e4d7d3cd40f4 req-6d2af64a-2368-4bb7-ae62-7c7f60e01dee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1acfc6ec-6e8f-4969-99e8-0de456fcb7ed", "tag": "6629f354-c1e7-44f4-90fa-1e340bce002d"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:36:50.902317 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-d6d81020-795b-4348-aff8-e4d7d3cd40f4 req-6d2af64a-2368-4bb7-ae62-7c7f60e01dee service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:50.902767 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-d6d81020-795b-4348-aff8-e4d7d3cd40f4 req-6d2af64a-2368-4bb7-ae62-7c7f60e01dee service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:50.916580 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-d6d81020-795b-4348-aff8-e4d7d3cd40f4 req-6d2af64a-2368-4bb7-ae62-7c7f60e01dee service nova] Creating event network-changed:6629f354-c1e7-44f4-90fa-1e340bce002d for instance 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed on hv-cinder-83699 May 23 12:36:50.922158 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-d6d81020-795b-4348-aff8-e4d7d3cd40f4 req-6d2af64a-2368-4bb7-ae62-7c7f60e01dee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037833 May 23 12:36:50.923596 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 223/442] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:36:54.777396 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-3513828a-60a4-4ff7-af8d-aaef3bc445b3 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:54.777919 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-3513828a-60a4-4ff7-af8d-aaef3bc445b3 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:54.784184 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3513828a-60a4-4ff7-af8d-aaef3bc445b3 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:54.784649 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3513828a-60a4-4ff7-af8d-aaef3bc445b3 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:54.785420 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3513828a-60a4-4ff7-af8d-aaef3bc445b3 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:54.785863 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3513828a-60a4-4ff7-af8d-aaef3bc445b3 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:54.919911 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.objects.instance [None req-3513828a-60a4-4ff7-af8d-aaef3bc445b3 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lazy-loading 'services' on Instance uuid 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e {{(pid=124200) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:36:55.042372 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-3513828a-60a4-4ff7-af8d-aaef3bc445b3 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "DELETE /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e/os-volume_attachments/0abf2e4f-4fa8-4e28-af2e-09430efd7bff" status: 202 len: 0 microversion: 2.1 time: 0.269272 May 23 12:36:55.042847 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 220/443] 10.222.0.16 () {58 vars in 1415 bytes} [Mon May 23 12:36:54 2022] DELETE /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e/os-volume_attachments/0abf2e4f-4fa8-4e28-af2e-09430efd7bff => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:36:55.430139 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c77824e4-f945-4e95-b889-97e9e21a1177 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:55.431228 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c77824e4-f945-4e95-b889-97e9e21a1177 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: a624bb16-d6b7-491a-9724-9a51af12140d] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:55.439013 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c77824e4-f945-4e95-b889-97e9e21a1177 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:55.439535 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c77824e4-f945-4e95-b889-97e9e21a1177 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:55.440466 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c77824e4-f945-4e95-b889-97e9e21a1177 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:55.440978 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c77824e4-f945-4e95-b889-97e9e21a1177 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:55.465397 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c77824e4-f945-4e95-b889-97e9e21a1177 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d/ips" status: 200 len: 149 microversion: 2.1 time: 0.041702 May 23 12:36:55.465962 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 224/444] 10.222.0.16 () {58 vars in 1247 bytes} [Mon May 23 12:36:55 2022] GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:36:55.477236 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-d08e8e40-e5ea-4860-96b1-15fbb0c0d578 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81415a1c-c003-43c5-8d76-5e65aacba281"}} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:36:55.478504 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-d08e8e40-e5ea-4860-96b1-15fbb0c0d578 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: a624bb16-d6b7-491a-9724-9a51af12140d] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:55.484835 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d08e8e40-e5ea-4860-96b1-15fbb0c0d578 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:55.485285 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d08e8e40-e5ea-4860-96b1-15fbb0c0d578 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:55.486051 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d08e8e40-e5ea-4860-96b1-15fbb0c0d578 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:55.486493 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d08e8e40-e5ea-4860-96b1-15fbb0c0d578 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:55.566735 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.wsgi [None req-d08e8e40-e5ea-4860-96b1-15fbb0c0d578 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] HTTP exception thrown: Invalid volume: volume 81415a1c-c003-43c5-8d76-5e65aacba281 is already attached to instances: 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 May 23 12:36:55.568488 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-d08e8e40-e5ea-4860-96b1-15fbb0c0d578 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Request method failure captured: May 23 12:36:55.568488 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: request: POST /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d/os-volume_attachments HTTP/1.1 May 23 12:36:55.568488 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept: application/json May 23 12:36:55.568488 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept-Encoding: identity May 23 12:36:55.568488 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Connection: close May 23 12:36:55.568488 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Length: 74 May 23 12:36:55.568488 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Type: application/json May 23 12:36:55.568488 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Host: 10.222.0.16 May 23 12:36:55.568488 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Openstack-System-Scope: None May 23 12:36:55.568488 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: User-Agent: python-urllib3/1.26.9 May 23 12:36:55.568488 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Auth-Token: gAAAAABii38ZU7Vwsw5AAU8G7deCk06Tjsg_k90-PVfeWrd3aNHg-oGVBFwUfnF7AZgHGAQrHmO4XQOE1Bz6uWE6i2CAUoXJsEuLNZGXvkqTPiv0H7N4ZSkFEsbSkgm2LM1J6iSbSGefN_01pdctKfH8BgGpUswrmPhK0nZLP7jsVPYKp_z7ea8 May 23 12:36:55.568488 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Id: None May 23 12:36:55.568488 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Name: None May 23 12:36:55.568488 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Identity-Status: Confirmed May 23 12:36:55.568488 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Is-Admin-Project: True May 23 12:36:55.568488 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Id: default May 23 12:36:55.568488 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Name: Default May 23 12:36:55.568488 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Id: da82f9c566664cb1a974cf0d1bf1b09d May 23 12:36:55.568488 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Name: tempest-AttachVolumeNegativeTest-2053273606 May 23 12:36:55.568488 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Role: member,reader May 23 12:36:55.568488 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Roles: member,reader May 23 12:36:55.570130 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da82f9c566664cb1a974cf0d1bf1b09d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da82f9c566664cb1a974cf0d1bf1b09d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da82f9c566664cb1a974cf0d1bf1b09d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da82f9c566664cb1a974cf0d1bf1b09d"}]}] May 23 12:36:55.570130 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant: tempest-AttachVolumeNegativeTest-2053273606 May 23 12:36:55.570130 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Id: da82f9c566664cb1a974cf0d1bf1b09d May 23 12:36:55.570130 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2053273606 May 23 12:36:55.570130 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User: tempest-AttachVolumeNegativeTest-2053273606-project May 23 12:36:55.570130 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Id: default May 23 12:36:55.570130 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Name: Default May 23 12:36:55.570130 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Id: ef222fe025534a9e942f8c5c4ed1e3e7 May 23 12:36:55.570130 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Name: tempest-AttachVolumeNegativeTest-2053273606-project May 23 12:36:55.570130 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: May 23 12:36:55.570130 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: {"volumeAttachment": {"volumeId": "81415a1c-c003-43c5-8d76-5e65aacba281"}} May 23 12:36:55.570130 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: method: > May 23 12:36:55.571628 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: exception: Invalid volume: volume 81415a1c-c003-43c5-8d76-5e65aacba281 is already attached to instances: 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 May 23 12:36:55.571628 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: action_args: {'server_id': 'a624bb16-d6b7-491a-9724-9a51af12140d', 'body': {'volumeAttachment': {'volumeId': '81415a1c-c003-43c5-8d76-5e65aacba281'}}} May 23 12:36:55.571628 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:36:55.571628 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:36:55.571628 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 23 12:36:55.571628 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 23 12:36:55.571628 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 12:36:55.571628 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 12:36:55.571628 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 23 12:36:55.571628 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 23 12:36:55.571628 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 23 12:36:55.571628 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 23 12:36:55.571628 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 23 12:36:55.571628 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 23 12:36:55.571628 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 81415a1c-c003-43c5-8d76-5e65aacba281 is already attached to instances: 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 May 23 12:36:55.571628 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:36:55.571628 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:36:55.571628 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:36:55.571628 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:36:55.572826 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:36:55.572826 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:36:55.572826 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:36:55.572826 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:36:55.572826 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:36:55.572826 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:36:55.572826 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 12:36:55.572826 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 12:36:55.572826 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 12:36:55.572826 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 12:36:55.572826 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 12:36:55.572826 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 12:36:55.572826 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 23 12:36:55.572826 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 23 12:36:55.572826 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 81415a1c-c003-43c5-8d76-5e65aacba281 is already attached to instances: 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 May 23 12:36:55.572826 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:36:55.572826 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:36:55.572826 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:36:55.572826 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:36:55.572826 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:36:55.574056 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:36:55.574056 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:36:55.574056 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:36:55.574056 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 81415a1c-c003-43c5-8d76-5e65aacba281 is already attached to instances: 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 May 23 12:36:55.574056 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:36:55.574056 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-d08e8e40-e5ea-4860-96b1-15fbb0c0d578 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Returning 400 to user: Invalid volume: volume 81415a1c-c003-43c5-8d76-5e65aacba281 is already attached to instances: 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 {{(pid=124200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:36:55.574056 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-d08e8e40-e5ea-4860-96b1-15fbb0c0d578 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "POST /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097255 May 23 12:36:55.574056 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 221/445] 10.222.0.16 () {60 vars in 1322 bytes} [Mon May 23 12:36:55 2022] POST /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 12:36:55.579854 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d13a0230-b280-411c-925c-d938ca9be374 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:55.580394 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d13a0230-b280-411c-925c-d938ca9be374 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: a624bb16-d6b7-491a-9724-9a51af12140d] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:55.586717 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d13a0230-b280-411c-925c-d938ca9be374 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:55.587168 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d13a0230-b280-411c-925c-d938ca9be374 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:55.587940 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d13a0230-b280-411c-925c-d938ca9be374 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:55.588421 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d13a0230-b280-411c-925c-d938ca9be374 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:55.613358 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d13a0230-b280-411c-925c-d938ca9be374 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: a624bb16-d6b7-491a-9724-9a51af12140d] Going to try to terminate instance {{(pid=124199) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 12:36:55.692872 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d13a0230-b280-411c-925c-d938ca9be374 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d" status: 204 len: 0 microversion: 2.1 time: 0.116666 May 23 12:36:55.693385 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 225/446] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 12:36:55 2022] DELETE /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 12:36:55.701994 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-91cd5e96-a836-48b0-beeb-bbdaa4e720bb tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:55.702643 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-91cd5e96-a836-48b0-beeb-bbdaa4e720bb tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: a624bb16-d6b7-491a-9724-9a51af12140d] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:55.709600 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-91cd5e96-a836-48b0-beeb-bbdaa4e720bb tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:55.710119 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-91cd5e96-a836-48b0-beeb-bbdaa4e720bb tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:55.711337 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-91cd5e96-a836-48b0-beeb-bbdaa4e720bb tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:55.711845 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-91cd5e96-a836-48b0-beeb-bbdaa4e720bb tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:55.865166 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-91cd5e96-a836-48b0-beeb-bbdaa4e720bb tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:55.873552 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-91cd5e96-a836-48b0-beeb-bbdaa4e720bb tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d" status: 200 len: 1681 microversion: 2.1 time: 0.175585 May 23 12:36:55.874087 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 222/447] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:55 2022] GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:56.892718 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c405de4c-63d7-4fcf-aefe-eaca0e9ba8ed tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:56.893418 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c405de4c-63d7-4fcf-aefe-eaca0e9ba8ed tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: a624bb16-d6b7-491a-9724-9a51af12140d] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:56.900450 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c405de4c-63d7-4fcf-aefe-eaca0e9ba8ed tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:56.900900 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c405de4c-63d7-4fcf-aefe-eaca0e9ba8ed tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:56.901667 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c405de4c-63d7-4fcf-aefe-eaca0e9ba8ed tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:56.902106 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c405de4c-63d7-4fcf-aefe-eaca0e9ba8ed tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:57.037294 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c405de4c-63d7-4fcf-aefe-eaca0e9ba8ed tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:57.045822 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c405de4c-63d7-4fcf-aefe-eaca0e9ba8ed tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d" status: 200 len: 1681 microversion: 2.1 time: 0.157312 May 23 12:36:57.046397 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 226/448] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:56 2022] GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:58.063594 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-fa688c49-b4a1-473a-89bf-91fc176ac884 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:58.064453 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-fa688c49-b4a1-473a-89bf-91fc176ac884 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: a624bb16-d6b7-491a-9724-9a51af12140d] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:58.071447 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-fa688c49-b4a1-473a-89bf-91fc176ac884 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:58.071898 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-fa688c49-b4a1-473a-89bf-91fc176ac884 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:58.072788 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-fa688c49-b4a1-473a-89bf-91fc176ac884 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:58.073224 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-fa688c49-b4a1-473a-89bf-91fc176ac884 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:58.154904 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-fa688c49-b4a1-473a-89bf-91fc176ac884 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:58.162681 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-fa688c49-b4a1-473a-89bf-91fc176ac884 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d" status: 200 len: 1613 microversion: 2.1 time: 0.103180 May 23 12:36:58.163548 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 223/449] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:58 2022] GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d => generated 1613 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:36:58.287280 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-3f7aa0cd-9ed9-44fd-89eb-680743648b53 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:36:58.301483 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3f7aa0cd-9ed9-44fd-89eb-680743648b53 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:58.302140 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3f7aa0cd-9ed9-44fd-89eb-680743648b53 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:58.344055 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-32385300-1754-4bde-98eb-ea14703361d3 req-1f0969c6-e5de-41ef-85f1-24bffb87ed91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a624bb16-d6b7-491a-9724-9a51af12140d", "name": "network-vif-deleted", "tag": "214009e0-0102-49c7-bbc1-24d5fb2d2f55"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:36:58.354038 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-32385300-1754-4bde-98eb-ea14703361d3 req-1f0969c6-e5de-41ef-85f1-24bffb87ed91 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:58.354758 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-32385300-1754-4bde-98eb-ea14703361d3 req-1f0969c6-e5de-41ef-85f1-24bffb87ed91 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:58.368301 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-3f7aa0cd-9ed9-44fd-89eb-680743648b53 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Going to try to stop instance {{(pid=124199) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 23 12:36:58.369489 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-32385300-1754-4bde-98eb-ea14703361d3 req-1f0969c6-e5de-41ef-85f1-24bffb87ed91 service nova] Creating event network-vif-deleted:214009e0-0102-49c7-bbc1-24d5fb2d2f55 for instance a624bb16-d6b7-491a-9724-9a51af12140d on hv-cinder-83699 May 23 12:36:58.375604 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-32385300-1754-4bde-98eb-ea14703361d3 req-1f0969c6-e5de-41ef-85f1-24bffb87ed91 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038774 May 23 12:36:58.376756 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 224/450] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:36:58.451537 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-3f7aa0cd-9ed9-44fd-89eb-680743648b53 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "POST /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e/action" status: 202 len: 0 microversion: 2.1 time: 0.171924 May 23 12:36:58.455664 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 227/451] 10.222.0.16 () {60 vars in 1277 bytes} [Mon May 23 12:36:58 2022] POST /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:36:58.462638 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-9ad26607-fff8-4041-b710-98a5c027392c tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:58.463344 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-9ad26607-fff8-4041-b710-98a5c027392c tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:58.472701 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9ad26607-fff8-4041-b710-98a5c027392c tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:58.473202 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9ad26607-fff8-4041-b710-98a5c027392c tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:58.474269 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9ad26607-fff8-4041-b710-98a5c027392c tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:58.474843 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9ad26607-fff8-4041-b710-98a5c027392c tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:58.631880 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-9ad26607-fff8-4041-b710-98a5c027392c tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:58.643878 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-9ad26607-fff8-4041-b710-98a5c027392c tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 200 len: 1676 microversion: 2.1 time: 0.185287 May 23 12:36:58.644446 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 225/452] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:58 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 1676 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:36:59.181740 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-263bc59f-b45f-4d05-9eb2-33b888d27cf0 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:59.182691 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-263bc59f-b45f-4d05-9eb2-33b888d27cf0 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: a624bb16-d6b7-491a-9724-9a51af12140d] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:59.184927 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:36:59.192394 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-263bc59f-b45f-4d05-9eb2-33b888d27cf0 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:59.193066 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-263bc59f-b45f-4d05-9eb2-33b888d27cf0 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:59.194046 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-263bc59f-b45f-4d05-9eb2-33b888d27cf0 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:59.194556 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-263bc59f-b45f-4d05-9eb2-33b888d27cf0 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:59.210430 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.wsgi [None req-263bc59f-b45f-4d05-9eb2-33b888d27cf0 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] HTTP exception thrown: Instance a624bb16-d6b7-491a-9724-9a51af12140d could not be found. May 23 12:36:59.212069 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-263bc59f-b45f-4d05-9eb2-33b888d27cf0 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Request method failure captured: May 23 12:36:59.212069 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: request: GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d HTTP/1.1 May 23 12:36:59.212069 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept: application/json May 23 12:36:59.212069 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept-Encoding: identity May 23 12:36:59.212069 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Connection: close May 23 12:36:59.212069 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Length: 0 May 23 12:36:59.212069 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Type: application/json May 23 12:36:59.212069 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Host: 10.222.0.16 May 23 12:36:59.212069 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Openstack-System-Scope: None May 23 12:36:59.212069 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: User-Agent: python-urllib3/1.26.9 May 23 12:36:59.212069 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Auth-Token: gAAAAABii38ZU7Vwsw5AAU8G7deCk06Tjsg_k90-PVfeWrd3aNHg-oGVBFwUfnF7AZgHGAQrHmO4XQOE1Bz6uWE6i2CAUoXJsEuLNZGXvkqTPiv0H7N4ZSkFEsbSkgm2LM1J6iSbSGefN_01pdctKfH8BgGpUswrmPhK0nZLP7jsVPYKp_z7ea8 May 23 12:36:59.212069 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Id: None May 23 12:36:59.212069 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Name: None May 23 12:36:59.212069 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Identity-Status: Confirmed May 23 12:36:59.212069 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Is-Admin-Project: True May 23 12:36:59.212069 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Id: default May 23 12:36:59.212069 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Name: Default May 23 12:36:59.212069 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Id: da82f9c566664cb1a974cf0d1bf1b09d May 23 12:36:59.212069 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Name: tempest-AttachVolumeNegativeTest-2053273606 May 23 12:36:59.212069 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Role: member,reader May 23 12:36:59.212069 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Roles: member,reader May 23 12:36:59.213644 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da82f9c566664cb1a974cf0d1bf1b09d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da82f9c566664cb1a974cf0d1bf1b09d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da82f9c566664cb1a974cf0d1bf1b09d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da82f9c566664cb1a974cf0d1bf1b09d"}]}] May 23 12:36:59.213644 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant: tempest-AttachVolumeNegativeTest-2053273606 May 23 12:36:59.213644 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Id: da82f9c566664cb1a974cf0d1bf1b09d May 23 12:36:59.213644 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2053273606 May 23 12:36:59.213644 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User: tempest-AttachVolumeNegativeTest-2053273606-project May 23 12:36:59.213644 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Id: default May 23 12:36:59.213644 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Name: Default May 23 12:36:59.213644 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Id: ef222fe025534a9e942f8c5c4ed1e3e7 May 23 12:36:59.213644 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Name: tempest-AttachVolumeNegativeTest-2053273606-project May 23 12:36:59.213644 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: method: > May 23 12:36:59.213644 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: exception: Instance a624bb16-d6b7-491a-9724-9a51af12140d could not be found. May 23 12:36:59.213644 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: action_args: {'id': 'a624bb16-d6b7-491a-9724-9a51af12140d'} May 23 12:36:59.214623 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:36:59.214623 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:36:59.214623 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:36:59.214623 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:36:59.214623 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:36:59.214623 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:36:59.214623 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:36:59.214623 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:36:59.214623 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:36:59.214623 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:36:59.214623 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a624bb16-d6b7-491a-9724-9a51af12140d could not be found. May 23 12:36:59.214623 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:36:59.214623 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:36:59.214623 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:36:59.214623 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:36:59.214623 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:36:59.214623 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:36:59.214623 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:36:59.214623 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:36:59.214623 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:36:59.216015 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:36:59.216015 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:36:59.216015 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:36:59.216015 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:36:59.216015 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:36:59.216015 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:36:59.216015 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:36:59.216015 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a624bb16-d6b7-491a-9724-9a51af12140d could not be found. May 23 12:36:59.216015 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:36:59.216015 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:36:59.216015 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:36:59.216015 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:36:59.216015 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:36:59.216015 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:36:59.216015 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:36:59.216015 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:36:59.216015 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a624bb16-d6b7-491a-9724-9a51af12140d could not be found. May 23 12:36:59.216015 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:36:59.217493 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-263bc59f-b45f-4d05-9eb2-33b888d27cf0 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Returning 404 to user: Instance a624bb16-d6b7-491a-9724-9a51af12140d could not be found. {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:36:59.217493 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-263bc59f-b45f-4d05-9eb2-33b888d27cf0 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d" status: 404 len: 111 microversion: 2.1 time: 0.037583 May 23 12:36:59.217493 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 228/453] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:59 2022] GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:36:59.223176 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-bef0167b-448b-4f95-892e-ba30c629f845 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '.version_select at 0x7f095c9ee8b0>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:59.244956 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-bef0167b-448b-4f95-892e-ba30c629f845 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1778784054" status: 202 len: 0 microversion: 2.1 time: 0.026036 May 23 12:36:59.246290 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 226/454] 10.222.0.16 () {58 vars in 1220 bytes} [Mon May 23 12:36:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1778784054 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:36:59.661991 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-7036faf7-5881-476d-b456-64f86adbaccf tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:36:59.663186 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-7036faf7-5881-476d-b456-64f86adbaccf tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:36:59.671227 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7036faf7-5881-476d-b456-64f86adbaccf tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:59.671935 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7036faf7-5881-476d-b456-64f86adbaccf tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:59.672951 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7036faf7-5881-476d-b456-64f86adbaccf tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:36:59.673560 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7036faf7-5881-476d-b456-64f86adbaccf tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:36:59.830458 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-7036faf7-5881-476d-b456-64f86adbaccf tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:36:59.840432 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-7036faf7-5881-476d-b456-64f86adbaccf tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 200 len: 1676 microversion: 2.1 time: 0.182440 May 23 12:36:59.841025 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 229/455] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:36:59 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 1676 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:37:00.001669 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-4eaceb3e-8210-4ba5-b883-05419d6cde10 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:00.002272 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-4eaceb3e-8210-4ba5-b883-05419d6cde10 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:00.010436 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4eaceb3e-8210-4ba5-b883-05419d6cde10 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:00.012149 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4eaceb3e-8210-4ba5-b883-05419d6cde10 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:00.012393 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4eaceb3e-8210-4ba5-b883-05419d6cde10 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:00.012686 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4eaceb3e-8210-4ba5-b883-05419d6cde10 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:00.107472 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.objects.instance [None req-4eaceb3e-8210-4ba5-b883-05419d6cde10 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lazy-loading 'services' on Instance uuid 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 {{(pid=124200) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:37:00.180440 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-4eaceb3e-8210-4ba5-b883-05419d6cde10 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5/os-volume_attachments/81415a1c-c003-43c5-8d76-5e65aacba281" status: 202 len: 0 microversion: 2.1 time: 0.182820 May 23 12:37:00.181192 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 227/456] 10.222.0.16 () {58 vars in 1415 bytes} [Mon May 23 12:36:59 2022] DELETE /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5/os-volume_attachments/81415a1c-c003-43c5-8d76-5e65aacba281 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:37:00.191055 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c1c6fb91-ad7e-4bbc-91ef-f83142498a2f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:00.192032 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c1c6fb91-ad7e-4bbc-91ef-f83142498a2f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:00.199130 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c1c6fb91-ad7e-4bbc-91ef-f83142498a2f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:00.199557 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c1c6fb91-ad7e-4bbc-91ef-f83142498a2f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:00.200423 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c1c6fb91-ad7e-4bbc-91ef-f83142498a2f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:00.200856 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c1c6fb91-ad7e-4bbc-91ef-f83142498a2f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:00.238184 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c1c6fb91-ad7e-4bbc-91ef-f83142498a2f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052170 May 23 12:37:00.243111 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 230/457] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 12:37:00 2022] GET /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:37:00.860419 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-7321c5ea-612a-423b-b5b2-45a4cee874b3 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:00.861187 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-7321c5ea-612a-423b-b5b2-45a4cee874b3 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:00.869313 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7321c5ea-612a-423b-b5b2-45a4cee874b3 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:00.869809 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7321c5ea-612a-423b-b5b2-45a4cee874b3 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:00.870852 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7321c5ea-612a-423b-b5b2-45a4cee874b3 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:00.871295 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7321c5ea-612a-423b-b5b2-45a4cee874b3 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:01.012870 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-7321c5ea-612a-423b-b5b2-45a4cee874b3 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:01.020375 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-7321c5ea-612a-423b-b5b2-45a4cee874b3 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 200 len: 1676 microversion: 2.1 time: 0.165106 May 23 12:37:01.020942 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 228/458] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:00 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:37:01.250346 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-1662e7bf-c6e5-45c4-9c15-95dfb498bd21 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:01.251306 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-1662e7bf-c6e5-45c4-9c15-95dfb498bd21 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:01.258886 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1662e7bf-c6e5-45c4-9c15-95dfb498bd21 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:01.259344 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1662e7bf-c6e5-45c4-9c15-95dfb498bd21 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:01.260129 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1662e7bf-c6e5-45c4-9c15-95dfb498bd21 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:01.260597 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1662e7bf-c6e5-45c4-9c15-95dfb498bd21 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:01.293771 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-1662e7bf-c6e5-45c4-9c15-95dfb498bd21 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047397 May 23 12:37:01.294347 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 231/459] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 12:37:01 2022] GET /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 12:37:01.355192 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-0761f48e-7834-46a3-8cd1-174e4623ab95 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:01.355885 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-0761f48e-7834-46a3-8cd1-174e4623ab95 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:01.362621 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0761f48e-7834-46a3-8cd1-174e4623ab95 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:01.363030 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0761f48e-7834-46a3-8cd1-174e4623ab95 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:01.363800 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0761f48e-7834-46a3-8cd1-174e4623ab95 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:01.364262 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0761f48e-7834-46a3-8cd1-174e4623ab95 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:01.390526 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-0761f48e-7834-46a3-8cd1-174e4623ab95 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5] Going to try to terminate instance {{(pid=124200) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 12:37:01.470773 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-0761f48e-7834-46a3-8cd1-174e4623ab95 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5" status: 204 len: 0 microversion: 2.1 time: 0.119109 May 23 12:37:01.471755 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 229/460] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 12:37:01 2022] DELETE /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 12:37:01.483276 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-4a7a0a9f-5e75-47a8-9411-8c466870f628 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:01.484245 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-4a7a0a9f-5e75-47a8-9411-8c466870f628 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:01.490727 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4a7a0a9f-5e75-47a8-9411-8c466870f628 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:01.491276 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4a7a0a9f-5e75-47a8-9411-8c466870f628 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:01.492667 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4a7a0a9f-5e75-47a8-9411-8c466870f628 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:01.493107 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4a7a0a9f-5e75-47a8-9411-8c466870f628 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:01.622969 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-4a7a0a9f-5e75-47a8-9411-8c466870f628 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:01.630488 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-4a7a0a9f-5e75-47a8-9411-8c466870f628 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5" status: 200 len: 1680 microversion: 2.1 time: 0.152247 May 23 12:37:01.631046 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 232/461] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:01 2022] GET /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:37:02.038640 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-6133165f-ce22-4f26-ad57-bf05b8908d75 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:02.040282 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-6133165f-ce22-4f26-ad57-bf05b8908d75 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:02.046732 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6133165f-ce22-4f26-ad57-bf05b8908d75 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:02.047178 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6133165f-ce22-4f26-ad57-bf05b8908d75 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:02.047932 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6133165f-ce22-4f26-ad57-bf05b8908d75 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:02.048396 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6133165f-ce22-4f26-ad57-bf05b8908d75 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:02.183384 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-6133165f-ce22-4f26-ad57-bf05b8908d75 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:02.190852 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-6133165f-ce22-4f26-ad57-bf05b8908d75 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 200 len: 1676 microversion: 2.1 time: 0.156377 May 23 12:37:02.191408 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 230/462] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:02 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:37:02.650653 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d0075e61-a3cf-4735-9052-0bd47d31044b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:02.651182 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d0075e61-a3cf-4735-9052-0bd47d31044b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:02.657768 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d0075e61-a3cf-4735-9052-0bd47d31044b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:02.658215 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d0075e61-a3cf-4735-9052-0bd47d31044b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:02.658984 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d0075e61-a3cf-4735-9052-0bd47d31044b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:02.659502 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d0075e61-a3cf-4735-9052-0bd47d31044b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:02.801603 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d0075e61-a3cf-4735-9052-0bd47d31044b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:02.810049 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d0075e61-a3cf-4735-9052-0bd47d31044b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5" status: 200 len: 1680 microversion: 2.1 time: 0.164208 May 23 12:37:02.810651 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 233/463] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:02 2022] GET /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:37:03.211418 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-4e7c4139-8410-4b66-82cb-03178313e4ff tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:03.212111 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-4e7c4139-8410-4b66-82cb-03178313e4ff tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:03.218880 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4e7c4139-8410-4b66-82cb-03178313e4ff tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:03.219325 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4e7c4139-8410-4b66-82cb-03178313e4ff tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:03.220091 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4e7c4139-8410-4b66-82cb-03178313e4ff tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:03.220552 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4e7c4139-8410-4b66-82cb-03178313e4ff tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:03.370751 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-4e7c4139-8410-4b66-82cb-03178313e4ff tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:03.378380 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-4e7c4139-8410-4b66-82cb-03178313e4ff tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 200 len: 1676 microversion: 2.1 time: 0.171080 May 23 12:37:03.378946 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 231/464] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:03 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:37:03.829340 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-6e4aa578-84d2-4abe-b0ce-2153d5c9ab78 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:03.829951 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-6e4aa578-84d2-4abe-b0ce-2153d5c9ab78 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:03.837525 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6e4aa578-84d2-4abe-b0ce-2153d5c9ab78 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:03.837978 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6e4aa578-84d2-4abe-b0ce-2153d5c9ab78 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:03.838743 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6e4aa578-84d2-4abe-b0ce-2153d5c9ab78 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:03.839178 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6e4aa578-84d2-4abe-b0ce-2153d5c9ab78 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:03.986660 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-6e4aa578-84d2-4abe-b0ce-2153d5c9ab78 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:03.994164 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-6e4aa578-84d2-4abe-b0ce-2153d5c9ab78 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5" status: 200 len: 1680 microversion: 2.1 time: 0.168917 May 23 12:37:03.994724 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 234/465] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:03 2022] GET /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:37:04.394958 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-4bb639ae-d32f-4b19-a2b5-9f05049bcf8c tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:04.395570 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-4bb639ae-d32f-4b19-a2b5-9f05049bcf8c tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:04.403596 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4bb639ae-d32f-4b19-a2b5-9f05049bcf8c tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:04.404057 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4bb639ae-d32f-4b19-a2b5-9f05049bcf8c tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:04.404860 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4bb639ae-d32f-4b19-a2b5-9f05049bcf8c tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:04.405294 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4bb639ae-d32f-4b19-a2b5-9f05049bcf8c tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:04.617699 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-4bb639ae-d32f-4b19-a2b5-9f05049bcf8c tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:04.633730 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-4bb639ae-d32f-4b19-a2b5-9f05049bcf8c tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 200 len: 1676 microversion: 2.1 time: 0.240542 May 23 12:37:04.645614 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 232/466] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:04 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 1676 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:37:05.011519 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-be85a597-0be1-4fd7-bab8-1ae973582129 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:05.012205 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-be85a597-0be1-4fd7-bab8-1ae973582129 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:05.020283 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-be85a597-0be1-4fd7-bab8-1ae973582129 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:05.021078 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-be85a597-0be1-4fd7-bab8-1ae973582129 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:05.022931 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-be85a597-0be1-4fd7-bab8-1ae973582129 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:05.023800 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-be85a597-0be1-4fd7-bab8-1ae973582129 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:05.123691 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-be85a597-0be1-4fd7-bab8-1ae973582129 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:05.125929 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:05.133373 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-be85a597-0be1-4fd7-bab8-1ae973582129 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5" status: 200 len: 1613 microversion: 2.1 time: 0.125058 May 23 12:37:05.133957 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 235/467] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:05 2022] GET /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 => generated 1613 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:37:05.241098 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-503c2e19-8099-4e6d-a131-4cf4e4c070d0 req-f79ad454-3173-46ef-8a6b-2c9acd01fbae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5", "name": "network-vif-deleted", "tag": "25a3b497-66c4-4bc0-887a-9599ceea33ec"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:37:05.250836 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-503c2e19-8099-4e6d-a131-4cf4e4c070d0 req-f79ad454-3173-46ef-8a6b-2c9acd01fbae service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:05.251307 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-503c2e19-8099-4e6d-a131-4cf4e4c070d0 req-f79ad454-3173-46ef-8a6b-2c9acd01fbae service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:05.264233 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-503c2e19-8099-4e6d-a131-4cf4e4c070d0 req-f79ad454-3173-46ef-8a6b-2c9acd01fbae service nova] Creating event network-vif-deleted:25a3b497-66c4-4bc0-887a-9599ceea33ec for instance 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 on hv-cinder-83699 May 23 12:37:05.269854 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-503c2e19-8099-4e6d-a131-4cf4e4c070d0 req-f79ad454-3173-46ef-8a6b-2c9acd01fbae service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032200 May 23 12:37:05.273639 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 233/468] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:37:05.654815 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-3f93c0c7-39d5-4d45-980b-1149bbde439d tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:05.655580 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-3f93c0c7-39d5-4d45-980b-1149bbde439d tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:05.663077 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3f93c0c7-39d5-4d45-980b-1149bbde439d tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:05.664325 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3f93c0c7-39d5-4d45-980b-1149bbde439d tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:05.665264 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3f93c0c7-39d5-4d45-980b-1149bbde439d tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:05.665762 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3f93c0c7-39d5-4d45-980b-1149bbde439d tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:05.825760 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-3f93c0c7-39d5-4d45-980b-1149bbde439d tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:05.844163 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-3f93c0c7-39d5-4d45-980b-1149bbde439d tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 200 len: 1676 microversion: 2.1 time: 0.193617 May 23 12:37:05.845668 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 236/469] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:05 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 1676 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:37:06.156488 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-dcd471a5-d6e8-469e-a1ea-75b1caa38804 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:06.157678 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-dcd471a5-d6e8-469e-a1ea-75b1caa38804 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:06.168506 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-dcd471a5-d6e8-469e-a1ea-75b1caa38804 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:06.169320 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-dcd471a5-d6e8-469e-a1ea-75b1caa38804 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:06.170941 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-dcd471a5-d6e8-469e-a1ea-75b1caa38804 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:06.171804 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-dcd471a5-d6e8-469e-a1ea-75b1caa38804 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:06.194596 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.wsgi [None req-dcd471a5-d6e8-469e-a1ea-75b1caa38804 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] HTTP exception thrown: Instance 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 could not be found. May 23 12:37:06.197646 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-dcd471a5-d6e8-469e-a1ea-75b1caa38804 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Request method failure captured: May 23 12:37:06.197646 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: request: GET /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 HTTP/1.1 May 23 12:37:06.197646 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept: application/json May 23 12:37:06.197646 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept-Encoding: identity May 23 12:37:06.197646 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Connection: close May 23 12:37:06.197646 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Length: 0 May 23 12:37:06.197646 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Type: application/json May 23 12:37:06.197646 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Host: 10.222.0.16 May 23 12:37:06.197646 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Openstack-System-Scope: None May 23 12:37:06.197646 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: User-Agent: python-urllib3/1.26.9 May 23 12:37:06.197646 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Auth-Token: gAAAAABii38ZU7Vwsw5AAU8G7deCk06Tjsg_k90-PVfeWrd3aNHg-oGVBFwUfnF7AZgHGAQrHmO4XQOE1Bz6uWE6i2CAUoXJsEuLNZGXvkqTPiv0H7N4ZSkFEsbSkgm2LM1J6iSbSGefN_01pdctKfH8BgGpUswrmPhK0nZLP7jsVPYKp_z7ea8 May 23 12:37:06.197646 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Id: None May 23 12:37:06.197646 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Name: None May 23 12:37:06.197646 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Identity-Status: Confirmed May 23 12:37:06.197646 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Is-Admin-Project: True May 23 12:37:06.197646 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Id: default May 23 12:37:06.197646 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Name: Default May 23 12:37:06.197646 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Id: da82f9c566664cb1a974cf0d1bf1b09d May 23 12:37:06.197646 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Name: tempest-AttachVolumeNegativeTest-2053273606 May 23 12:37:06.197646 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Role: member,reader May 23 12:37:06.197646 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Roles: member,reader May 23 12:37:06.200285 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da82f9c566664cb1a974cf0d1bf1b09d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da82f9c566664cb1a974cf0d1bf1b09d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da82f9c566664cb1a974cf0d1bf1b09d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da82f9c566664cb1a974cf0d1bf1b09d"}]}] May 23 12:37:06.200285 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant: tempest-AttachVolumeNegativeTest-2053273606 May 23 12:37:06.200285 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Id: da82f9c566664cb1a974cf0d1bf1b09d May 23 12:37:06.200285 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2053273606 May 23 12:37:06.200285 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User: tempest-AttachVolumeNegativeTest-2053273606-project May 23 12:37:06.200285 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Id: default May 23 12:37:06.200285 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Name: Default May 23 12:37:06.200285 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Id: ef222fe025534a9e942f8c5c4ed1e3e7 May 23 12:37:06.200285 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Name: tempest-AttachVolumeNegativeTest-2053273606-project May 23 12:37:06.200285 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: method: > May 23 12:37:06.200285 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: exception: Instance 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 could not be found. May 23 12:37:06.200285 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: action_args: {'id': '9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5'} May 23 12:37:06.201812 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:37:06.201812 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:37:06.201812 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:37:06.201812 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:37:06.201812 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:37:06.201812 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:37:06.201812 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:37:06.201812 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:37:06.201812 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:37:06.201812 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:37:06.201812 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 could not be found. May 23 12:37:06.201812 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:37:06.201812 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:37:06.201812 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:37:06.201812 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:37:06.201812 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:37:06.201812 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:37:06.201812 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:37:06.201812 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:37:06.201812 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:37:06.204527 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:37:06.204527 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:37:06.204527 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:37:06.204527 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:37:06.204527 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:37:06.204527 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:37:06.204527 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:37:06.204527 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 could not be found. May 23 12:37:06.204527 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:37:06.204527 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:37:06.204527 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:37:06.204527 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:37:06.204527 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:37:06.204527 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:37:06.204527 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:37:06.204527 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:37:06.204527 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 could not be found. May 23 12:37:06.204527 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:37:06.208391 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-dcd471a5-d6e8-469e-a1ea-75b1caa38804 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Returning 404 to user: Instance 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 could not be found. {{(pid=124200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:37:06.209232 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-dcd471a5-d6e8-469e-a1ea-75b1caa38804 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5" status: 404 len: 111 microversion: 2.1 time: 0.061954 May 23 12:37:06.210459 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 234/470] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:06 2022] GET /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 12:37:06.220912 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-bd03e5b8-41b9-4923-8b04-35168da6acc8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '.version_select at 0x7f095d279ca0>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:06.257904 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-bd03e5b8-41b9-4923-8b04-35168da6acc8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-317774095" status: 202 len: 0 microversion: 2.1 time: 0.039299 May 23 12:37:06.258852 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 237/471] 10.222.0.16 () {58 vars in 1217 bytes} [Mon May 23 12:37:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-317774095 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:37:06.867368 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-c79b91a6-d1f5-4115-bdaa-ff6d353369f9 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:06.867916 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-c79b91a6-d1f5-4115-bdaa-ff6d353369f9 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:06.876709 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c79b91a6-d1f5-4115-bdaa-ff6d353369f9 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:06.877449 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c79b91a6-d1f5-4115-bdaa-ff6d353369f9 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:06.878939 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c79b91a6-d1f5-4115-bdaa-ff6d353369f9 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:06.879944 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c79b91a6-d1f5-4115-bdaa-ff6d353369f9 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:06.900150 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:06.972987 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-04a5c228-8800-43ec-804a-b2d529d7bce5 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Action: 'create', calling method: .version_select at 0x7f095d35c040>, body: {"keypair": {"name": "tempest-keypair-1527802113", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIfeIa43pv2PLvhPbr0+wK81+MXq5I03D/9Lj82nudlyXyou+9GKnUG9wthpBSW2SdiJjGPr5KBRJZYfAuE0GLzLvF/+IHR/7Hg6r9ZV1CyQpfDPd2RPwY7XQKreo0fd0A=="}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:37:06.989488 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-04a5c228-8800-43ec-804a-b2d529d7bce5 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Getting quotas for project da82f9c566664cb1a974cf0d1bf1b09d. Resources: {'key_pairs'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:37:06.994453 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-04a5c228-8800-43ec-804a-b2d529d7bce5 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Getting quotas for user ef222fe025534a9e942f8c5c4ed1e3e7 and project da82f9c566664cb1a974cf0d1bf1b09d. Resources: {'key_pairs'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:37:07.033916 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-04a5c228-8800-43ec-804a-b2d529d7bce5 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.065353 May 23 12:37:07.034631 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 238/472] 10.222.0.16 () {60 vars in 1158 bytes} [Mon May 23 12:37:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:37:07.056998 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-c79b91a6-d1f5-4115-bdaa-ff6d353369f9 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:07.066517 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-c79b91a6-d1f5-4115-bdaa-ff6d353369f9 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 200 len: 1676 microversion: 2.1 time: 0.203377 May 23 12:37:07.067359 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 235/473] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:06 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 1676 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:37:08.090426 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-fd74162c-376d-4af6-b0c3-75fd3d1bdced tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:08.091362 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-fd74162c-376d-4af6-b0c3-75fd3d1bdced tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:08.100203 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fd74162c-376d-4af6-b0c3-75fd3d1bdced tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:08.100872 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fd74162c-376d-4af6-b0c3-75fd3d1bdced tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:08.102129 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fd74162c-376d-4af6-b0c3-75fd3d1bdced tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:08.102793 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fd74162c-376d-4af6-b0c3-75fd3d1bdced tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:08.306587 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-fd74162c-376d-4af6-b0c3-75fd3d1bdced tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:08.315961 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-fd74162c-376d-4af6-b0c3-75fd3d1bdced tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 200 len: 1676 microversion: 2.1 time: 0.232974 May 23 12:37:08.316576 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 239/474] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:08 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 1676 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:37:08.502876 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-9a4079f5-e482-4132-9a05-b45c47512c3b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-892118052", "imageRef": "bb11dfa4-2977-4163-8237-78c871c8437f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "34e447e2-b5a8-48e8-88c3-11c08d0cb74a"}], "security_groups": [{"name": "tempest-securitygroup--1021161102"}], "key_name": "tempest-keypair-1527802113", "user_data": "}} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:37:08.620079 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.network.neutron [None req-9a4079f5-e482-4132-9a05-b45c47512c3b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] validate_networks() for [('34e447e2-b5a8-48e8-88c3-11c08d0cb74a', None, None, None, None, None)] {{(pid=124200) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 12:37:09.271657 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-9a4079f5-e482-4132-9a05-b45c47512c3b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Flavor limits 0:0:0 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 12:37:09.272153 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-9a4079f5-e482-4132-9a05-b45c47512c3b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Image limits 0:0:0 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 12:37:09.272717 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-9a4079f5-e482-4132-9a05-b45c47512c3b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Flavor pref 0:0:0 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 12:37:09.273878 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-9a4079f5-e482-4132-9a05-b45c47512c3b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Image pref 0:0:0 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 12:37:09.274402 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-9a4079f5-e482-4132-9a05-b45c47512c3b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 12:37:09.276459 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:09.286316 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9a4079f5-e482-4132-9a05-b45c47512c3b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:09.286772 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9a4079f5-e482-4132-9a05-b45c47512c3b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:09.287583 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9a4079f5-e482-4132-9a05-b45c47512c3b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:09.288023 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9a4079f5-e482-4132-9a05-b45c47512c3b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:09.306348 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.quota [None req-9a4079f5-e482-4132-9a05-b45c47512c3b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Getting quotas for project da82f9c566664cb1a974cf0d1bf1b09d. Resources: {'instances', 'cores', 'ram'} {{(pid=124200) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:37:09.310403 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.quota [None req-9a4079f5-e482-4132-9a05-b45c47512c3b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Getting quotas for user ef222fe025534a9e942f8c5c4ed1e3e7 and project da82f9c566664cb1a974cf0d1bf1b09d. Resources: {'instances', 'cores', 'ram'} {{(pid=124200) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:37:09.322716 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-9a4079f5-e482-4132-9a05-b45c47512c3b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Going to run 1 instances... {{(pid=124200) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 12:37:09.324879 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-9a4079f5-e482-4132-9a05-b45c47512c3b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: f2e15c2c-04cc-435b-a633-39c4ae1a5e24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb11dfa4-2977-4163-8237-78c871c8437f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124200) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 12:37:09.338760 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-5dc02165-eab8-491f-9766-60f65410c115 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:09.339647 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-5dc02165-eab8-491f-9766-60f65410c115 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:09.345901 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5dc02165-eab8-491f-9766-60f65410c115 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:09.346357 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5dc02165-eab8-491f-9766-60f65410c115 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:09.347135 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5dc02165-eab8-491f-9766-60f65410c115 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:09.347571 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5dc02165-eab8-491f-9766-60f65410c115 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:09.381568 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-9a4079f5-e482-4132-9a05-b45c47512c3b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.882731 May 23 12:37:09.383448 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 236/475] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 23 12:37:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 885 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 12:37:09.401234 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-9b90f7ec-954a-4f62-afde-0b18b4067f74 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:09.402241 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-9b90f7ec-954a-4f62-afde-0b18b4067f74 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: f2e15c2c-04cc-435b-a633-39c4ae1a5e24] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:09.511158 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-9b90f7ec-954a-4f62-afde-0b18b4067f74 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:09.525216 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-9b90f7ec-954a-4f62-afde-0b18b4067f74 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24" status: 200 len: 1241 microversion: 2.1 time: 0.131585 May 23 12:37:09.526049 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 237/476] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:09 2022] GET /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24 => generated 1241 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:37:09.553222 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-5dc02165-eab8-491f-9766-60f65410c115 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:09.563489 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-5dc02165-eab8-491f-9766-60f65410c115 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 200 len: 1676 microversion: 2.1 time: 0.232916 May 23 12:37:09.564444 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 240/477] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:09 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 1676 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:37:10.544497 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-3f8057ee-1d99-4f24-8b54-f31b428398dc tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:10.546813 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-3f8057ee-1d99-4f24-8b54-f31b428398dc tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: f2e15c2c-04cc-435b-a633-39c4ae1a5e24] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:10.556298 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3f8057ee-1d99-4f24-8b54-f31b428398dc tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:10.556507 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3f8057ee-1d99-4f24-8b54-f31b428398dc tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:10.557396 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3f8057ee-1d99-4f24-8b54-f31b428398dc tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:10.557648 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3f8057ee-1d99-4f24-8b54-f31b428398dc tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:10.586795 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-4201b2c0-3b3b-49cc-a104-d019d8c93be8 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:10.587898 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-4201b2c0-3b3b-49cc-a104-d019d8c93be8 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:10.598174 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4201b2c0-3b3b-49cc-a104-d019d8c93be8 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:10.599153 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4201b2c0-3b3b-49cc-a104-d019d8c93be8 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:10.600755 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4201b2c0-3b3b-49cc-a104-d019d8c93be8 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:10.602065 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4201b2c0-3b3b-49cc-a104-d019d8c93be8 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:10.639159 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-3f8057ee-1d99-4f24-8b54-f31b428398dc tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:10.650252 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-3f8057ee-1d99-4f24-8b54-f31b428398dc tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24" status: 200 len: 1299 microversion: 2.1 time: 0.111224 May 23 12:37:10.650852 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 238/478] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:10 2022] GET /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24 => generated 1299 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:37:10.807381 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-4201b2c0-3b3b-49cc-a104-d019d8c93be8 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:10.814931 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-4201b2c0-3b3b-49cc-a104-d019d8c93be8 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 200 len: 1676 microversion: 2.1 time: 0.235310 May 23 12:37:10.815508 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 241/479] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:10 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 1676 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:37:11.669319 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-fa27a63a-756d-4b02-b76f-e6947b6caa0e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:11.670328 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-fa27a63a-756d-4b02-b76f-e6947b6caa0e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: f2e15c2c-04cc-435b-a633-39c4ae1a5e24] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:11.677276 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-fa27a63a-756d-4b02-b76f-e6947b6caa0e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:11.678008 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-fa27a63a-756d-4b02-b76f-e6947b6caa0e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:11.678793 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-fa27a63a-756d-4b02-b76f-e6947b6caa0e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:11.679247 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-fa27a63a-756d-4b02-b76f-e6947b6caa0e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:11.835313 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-56b0fd99-a79b-4cbb-b1d1-9c02cc05099a tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:11.836095 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-56b0fd99-a79b-4cbb-b1d1-9c02cc05099a tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:11.844504 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-56b0fd99-a79b-4cbb-b1d1-9c02cc05099a tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:11.845214 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-56b0fd99-a79b-4cbb-b1d1-9c02cc05099a tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:11.846799 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-56b0fd99-a79b-4cbb-b1d1-9c02cc05099a tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:11.847472 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-56b0fd99-a79b-4cbb-b1d1-9c02cc05099a tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:11.911587 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-fa27a63a-756d-4b02-b76f-e6947b6caa0e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:11.926278 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-fa27a63a-756d-4b02-b76f-e6947b6caa0e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24" status: 200 len: 1367 microversion: 2.1 time: 0.262688 May 23 12:37:11.927281 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 239/480] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:11 2022] GET /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24 => generated 1367 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:37:12.062495 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-56b0fd99-a79b-4cbb-b1d1-9c02cc05099a tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:12.071149 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-56b0fd99-a79b-4cbb-b1d1-9c02cc05099a tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 200 len: 1676 microversion: 2.1 time: 0.241291 May 23 12:37:12.072076 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 242/481] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:11 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 1676 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:37:12.182419 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-5e9b0f3b-ee29-4397-95b2-50191956c6d2 req-0c246e0c-4ec1-4b11-b83d-7240c5d62c7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2e15c2c-04cc-435b-a633-39c4ae1a5e24", "tag": "e4be8f3d-d13e-41b9-8480-75814c3ff785"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:37:12.196032 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-5e9b0f3b-ee29-4397-95b2-50191956c6d2 req-0c246e0c-4ec1-4b11-b83d-7240c5d62c7d service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:12.196995 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-5e9b0f3b-ee29-4397-95b2-50191956c6d2 req-0c246e0c-4ec1-4b11-b83d-7240c5d62c7d service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:12.217159 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-5e9b0f3b-ee29-4397-95b2-50191956c6d2 req-0c246e0c-4ec1-4b11-b83d-7240c5d62c7d service nova] Creating event network-changed:e4be8f3d-d13e-41b9-8480-75814c3ff785 for instance f2e15c2c-04cc-435b-a633-39c4ae1a5e24 on hv-cinder-83699 May 23 12:37:12.222086 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-5e9b0f3b-ee29-4397-95b2-50191956c6d2 req-0c246e0c-4ec1-4b11-b83d-7240c5d62c7d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048213 May 23 12:37:12.222681 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 240/482] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:37:12.946852 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f6e948bc-7566-49d4-8253-3af0e961d997 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:12.947408 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-f6e948bc-7566-49d4-8253-3af0e961d997 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: f2e15c2c-04cc-435b-a633-39c4ae1a5e24] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:12.954265 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f6e948bc-7566-49d4-8253-3af0e961d997 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:12.954708 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f6e948bc-7566-49d4-8253-3af0e961d997 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:12.955474 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f6e948bc-7566-49d4-8253-3af0e961d997 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:12.955901 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f6e948bc-7566-49d4-8253-3af0e961d997 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:13.092036 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-40721929-2b84-4175-b5c0-3b7344a0d021 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:13.093072 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-40721929-2b84-4175-b5c0-3b7344a0d021 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:13.095811 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f6e948bc-7566-49d4-8253-3af0e961d997 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:13.099707 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-40721929-2b84-4175-b5c0-3b7344a0d021 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:13.100270 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-40721929-2b84-4175-b5c0-3b7344a0d021 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:13.101101 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-40721929-2b84-4175-b5c0-3b7344a0d021 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:13.101546 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-40721929-2b84-4175-b5c0-3b7344a0d021 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:13.104383 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f6e948bc-7566-49d4-8253-3af0e961d997 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24" status: 200 len: 1367 microversion: 2.1 time: 0.162468 May 23 12:37:13.105043 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 243/483] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:12 2022] GET /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:37:13.236138 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-40721929-2b84-4175-b5c0-3b7344a0d021 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:13.245976 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-40721929-2b84-4175-b5c0-3b7344a0d021 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 200 len: 1676 microversion: 2.1 time: 0.158938 May 23 12:37:13.246790 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 241/484] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:13 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:37:14.122468 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-da02779e-104c-4946-988f-5fac710067b4 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:14.123227 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-da02779e-104c-4946-988f-5fac710067b4 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: f2e15c2c-04cc-435b-a633-39c4ae1a5e24] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:14.129889 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-da02779e-104c-4946-988f-5fac710067b4 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:14.130347 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-da02779e-104c-4946-988f-5fac710067b4 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:14.131136 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-da02779e-104c-4946-988f-5fac710067b4 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:14.131575 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-da02779e-104c-4946-988f-5fac710067b4 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:14.263799 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-f973fd18-0f25-4f16-bcd2-4e134caa0968 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:14.264364 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-f973fd18-0f25-4f16-bcd2-4e134caa0968 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:14.271443 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f973fd18-0f25-4f16-bcd2-4e134caa0968 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:14.271897 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f973fd18-0f25-4f16-bcd2-4e134caa0968 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:14.272754 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f973fd18-0f25-4f16-bcd2-4e134caa0968 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:14.274189 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f973fd18-0f25-4f16-bcd2-4e134caa0968 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:14.381231 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-da02779e-104c-4946-988f-5fac710067b4 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:14.390738 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-da02779e-104c-4946-988f-5fac710067b4 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24" status: 200 len: 1367 microversion: 2.1 time: 0.272195 May 23 12:37:14.395905 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 244/485] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:14 2022] GET /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24 => generated 1367 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:37:14.461326 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-f973fd18-0f25-4f16-bcd2-4e134caa0968 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:14.469025 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-f973fd18-0f25-4f16-bcd2-4e134caa0968 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 200 len: 1653 microversion: 2.1 time: 0.209373 May 23 12:37:14.469596 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 242/486] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:14 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 1653 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:37:14.492568 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-985f0465-b09b-401b-91fb-04e4ed24e3bb tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:37:14.499053 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-985f0465-b09b-401b-91fb-04e4ed24e3bb tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:14.499513 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-985f0465-b09b-401b-91fb-04e4ed24e3bb tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:14.525137 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-985f0465-b09b-401b-91fb-04e4ed24e3bb tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Going to try to start instance {{(pid=124199) start /opt/stack/nova/nova/compute/api.py:2730}} May 23 12:37:14.571558 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-985f0465-b09b-401b-91fb-04e4ed24e3bb tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "POST /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e/action" status: 202 len: 0 microversion: 2.1 time: 0.084259 May 23 12:37:14.572160 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 245/487] 10.222.0.16 () {60 vars in 1277 bytes} [Mon May 23 12:37:14 2022] POST /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:37:14.580663 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-5466bb4c-3417-4a62-a64d-9b4869715273 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:14.581266 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-5466bb4c-3417-4a62-a64d-9b4869715273 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:14.588589 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5466bb4c-3417-4a62-a64d-9b4869715273 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:14.589043 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5466bb4c-3417-4a62-a64d-9b4869715273 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:14.589897 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5466bb4c-3417-4a62-a64d-9b4869715273 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:14.590332 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5466bb4c-3417-4a62-a64d-9b4869715273 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:14.825493 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-5466bb4c-3417-4a62-a64d-9b4869715273 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:14.833326 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-5466bb4c-3417-4a62-a64d-9b4869715273 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 200 len: 1662 microversion: 2.1 time: 0.256835 May 23 12:37:14.833906 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 243/488] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:14 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 1662 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:37:15.411843 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-03096a2d-3ac4-4e79-8bbd-778e45fb1f36 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:15.412676 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-03096a2d-3ac4-4e79-8bbd-778e45fb1f36 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: f2e15c2c-04cc-435b-a633-39c4ae1a5e24] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:15.421285 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-03096a2d-3ac4-4e79-8bbd-778e45fb1f36 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:15.421872 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-03096a2d-3ac4-4e79-8bbd-778e45fb1f36 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:15.422910 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-03096a2d-3ac4-4e79-8bbd-778e45fb1f36 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:15.423435 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-03096a2d-3ac4-4e79-8bbd-778e45fb1f36 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:15.581527 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-03096a2d-3ac4-4e79-8bbd-778e45fb1f36 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:15.589987 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-03096a2d-3ac4-4e79-8bbd-778e45fb1f36 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24" status: 200 len: 1367 microversion: 2.1 time: 0.184590 May 23 12:37:15.590550 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 246/489] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:15 2022] GET /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:37:15.852303 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-06ffdb9b-9bf6-46d2-b7f5-2e90754ef50c tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:15.853213 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-06ffdb9b-9bf6-46d2-b7f5-2e90754ef50c tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:15.863113 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-06ffdb9b-9bf6-46d2-b7f5-2e90754ef50c tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:15.863849 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-06ffdb9b-9bf6-46d2-b7f5-2e90754ef50c tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:15.865023 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-06ffdb9b-9bf6-46d2-b7f5-2e90754ef50c tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:15.865754 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-06ffdb9b-9bf6-46d2-b7f5-2e90754ef50c tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:16.012531 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-06ffdb9b-9bf6-46d2-b7f5-2e90754ef50c tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:16.020633 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-06ffdb9b-9bf6-46d2-b7f5-2e90754ef50c tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 200 len: 1662 microversion: 2.1 time: 0.173274 May 23 12:37:16.021402 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 244/490] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:15 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 1662 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:37:16.608315 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-4be5a08a-ad4f-4577-873d-6765db5bd0c8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:16.609055 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-4be5a08a-ad4f-4577-873d-6765db5bd0c8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: f2e15c2c-04cc-435b-a633-39c4ae1a5e24] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:16.616792 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4be5a08a-ad4f-4577-873d-6765db5bd0c8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:16.617255 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4be5a08a-ad4f-4577-873d-6765db5bd0c8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:16.618051 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4be5a08a-ad4f-4577-873d-6765db5bd0c8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:16.618491 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4be5a08a-ad4f-4577-873d-6765db5bd0c8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:16.760316 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-4be5a08a-ad4f-4577-873d-6765db5bd0c8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:16.768051 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-4be5a08a-ad4f-4577-873d-6765db5bd0c8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24" status: 200 len: 1367 microversion: 2.1 time: 0.164448 May 23 12:37:16.768667 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 247/491] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:16 2022] GET /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:37:17.037978 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-59fad817-ec79-4701-b2a6-65d57814a838 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:17.038616 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-59fad817-ec79-4701-b2a6-65d57814a838 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:17.045191 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-59fad817-ec79-4701-b2a6-65d57814a838 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:17.045642 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-59fad817-ec79-4701-b2a6-65d57814a838 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:17.046423 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-59fad817-ec79-4701-b2a6-65d57814a838 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:17.046855 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-59fad817-ec79-4701-b2a6-65d57814a838 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:17.184698 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-59fad817-ec79-4701-b2a6-65d57814a838 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:17.193334 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-59fad817-ec79-4701-b2a6-65d57814a838 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 200 len: 1666 microversion: 2.1 time: 0.159158 May 23 12:37:17.193909 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 245/492] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:17 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 1666 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:37:17.785717 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-4fd7d4ba-b9a3-46ed-bb0e-11eb5fba5ef7 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:17.786364 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-4fd7d4ba-b9a3-46ed-bb0e-11eb5fba5ef7 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: f2e15c2c-04cc-435b-a633-39c4ae1a5e24] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:17.789242 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell0:SELECT=4 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:17.796029 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4fd7d4ba-b9a3-46ed-bb0e-11eb5fba5ef7 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:17.796455 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4fd7d4ba-b9a3-46ed-bb0e-11eb5fba5ef7 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:17.797245 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4fd7d4ba-b9a3-46ed-bb0e-11eb5fba5ef7 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:17.797689 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4fd7d4ba-b9a3-46ed-bb0e-11eb5fba5ef7 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:17.834090 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-8777cd07-19bf-42e9-852c-fe2ea22689ee req-21aff5bc-cc84-47b4-9102-347ac0775292 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2e15c2c-04cc-435b-a633-39c4ae1a5e24", "name": "network-vif-plugged", "status": "completed", "tag": "e4be8f3d-d13e-41b9-8480-75814c3ff785"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:37:17.845114 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-8777cd07-19bf-42e9-852c-fe2ea22689ee req-21aff5bc-cc84-47b4-9102-347ac0775292 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:17.845911 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-8777cd07-19bf-42e9-852c-fe2ea22689ee req-21aff5bc-cc84-47b4-9102-347ac0775292 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:17.869942 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-8777cd07-19bf-42e9-852c-fe2ea22689ee req-21aff5bc-cc84-47b4-9102-347ac0775292 service nova] Creating event network-vif-plugged:e4be8f3d-d13e-41b9-8480-75814c3ff785 for instance f2e15c2c-04cc-435b-a633-39c4ae1a5e24 on hv-cinder-83699 May 23 12:37:17.879960 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-8777cd07-19bf-42e9-852c-fe2ea22689ee req-21aff5bc-cc84-47b4-9102-347ac0775292 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050412 May 23 12:37:17.881165 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 246/493] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:37:17.956851 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-4fd7d4ba-b9a3-46ed-bb0e-11eb5fba5ef7 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:17.965731 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-4fd7d4ba-b9a3-46ed-bb0e-11eb5fba5ef7 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24" status: 200 len: 1367 microversion: 2.1 time: 0.183927 May 23 12:37:17.966313 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 248/494] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:17 2022] GET /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:37:18.983233 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-0c86959f-7bba-43c9-a3c0-3f063b2601e5 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:18.983934 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-0c86959f-7bba-43c9-a3c0-3f063b2601e5 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: f2e15c2c-04cc-435b-a633-39c4ae1a5e24] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:18.990822 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0c86959f-7bba-43c9-a3c0-3f063b2601e5 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:18.991277 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0c86959f-7bba-43c9-a3c0-3f063b2601e5 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:18.992079 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0c86959f-7bba-43c9-a3c0-3f063b2601e5 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:18.992547 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0c86959f-7bba-43c9-a3c0-3f063b2601e5 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:19.127546 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-0c86959f-7bba-43c9-a3c0-3f063b2601e5 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:19.135951 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-0c86959f-7bba-43c9-a3c0-3f063b2601e5 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24" status: 200 len: 1367 microversion: 2.1 time: 0.156837 May 23 12:37:19.136566 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 247/495] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:18 2022] GET /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:37:20.154676 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-03f18a9a-3394-45ed-8c5d-1cebb3a842e1 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:20.155355 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-03f18a9a-3394-45ed-8c5d-1cebb3a842e1 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: f2e15c2c-04cc-435b-a633-39c4ae1a5e24] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:20.163521 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-03f18a9a-3394-45ed-8c5d-1cebb3a842e1 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:20.164497 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-03f18a9a-3394-45ed-8c5d-1cebb3a842e1 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:20.165390 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-03f18a9a-3394-45ed-8c5d-1cebb3a842e1 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:20.165837 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-03f18a9a-3394-45ed-8c5d-1cebb3a842e1 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:20.309071 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-03f18a9a-3394-45ed-8c5d-1cebb3a842e1 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:20.316819 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-03f18a9a-3394-45ed-8c5d-1cebb3a842e1 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24" status: 200 len: 1557 microversion: 2.1 time: 0.167148 May 23 12:37:20.317389 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 249/496] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:20 2022] GET /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24 => generated 1557 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:37:20.333202 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-e464252f-a7ba-4b31-92c1-796a6f912a6b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:20.333760 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-e464252f-a7ba-4b31-92c1-796a6f912a6b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: f2e15c2c-04cc-435b-a633-39c4ae1a5e24] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:20.336115 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell0:SELECT=2 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:20.336809 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell0:SELECT=8 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:20.342852 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e464252f-a7ba-4b31-92c1-796a6f912a6b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:20.343290 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e464252f-a7ba-4b31-92c1-796a6f912a6b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:20.344053 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e464252f-a7ba-4b31-92c1-796a6f912a6b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:20.344524 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e464252f-a7ba-4b31-92c1-796a6f912a6b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:20.426878 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-e464252f-a7ba-4b31-92c1-796a6f912a6b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097518 May 23 12:37:20.427462 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 248/497] 10.222.0.16 () {58 vars in 1274 bytes} [Mon May 23 12:37:20 2022] GET /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:37:21.641693 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-521c5fa9-1c43-40e2-9f37-629cf8d5a50a req-5d5464ee-16cc-41ea-9b43-b2b326fe5375 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2e15c2c-04cc-435b-a633-39c4ae1a5e24", "tag": "e4be8f3d-d13e-41b9-8480-75814c3ff785"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:37:21.651538 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-521c5fa9-1c43-40e2-9f37-629cf8d5a50a req-5d5464ee-16cc-41ea-9b43-b2b326fe5375 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:21.652075 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-521c5fa9-1c43-40e2-9f37-629cf8d5a50a req-5d5464ee-16cc-41ea-9b43-b2b326fe5375 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:21.665820 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-521c5fa9-1c43-40e2-9f37-629cf8d5a50a req-5d5464ee-16cc-41ea-9b43-b2b326fe5375 service nova] Creating event network-changed:e4be8f3d-d13e-41b9-8480-75814c3ff785 for instance f2e15c2c-04cc-435b-a633-39c4ae1a5e24 on hv-cinder-83699 May 23 12:37:21.674023 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-521c5fa9-1c43-40e2-9f37-629cf8d5a50a req-5d5464ee-16cc-41ea-9b43-b2b326fe5375 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035554 May 23 12:37:21.674834 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 250/498] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:37:23.598991 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-ae2b43a8-e453-4732-af7c-53c1f63127e1 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23e14746-9a92-488b-94ab-ebfe7513e9da"}} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:37:23.599890 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-ae2b43a8-e453-4732-af7c-53c1f63127e1 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:23.606392 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ae2b43a8-e453-4732-af7c-53c1f63127e1 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:23.606872 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ae2b43a8-e453-4732-af7c-53c1f63127e1 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:23.607654 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ae2b43a8-e453-4732-af7c-53c1f63127e1 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:23.608092 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ae2b43a8-e453-4732-af7c-53c1f63127e1 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:23.851148 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-ae2b43a8-e453-4732-af7c-53c1f63127e1 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "POST /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256744 May 23 12:37:23.851989 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 249/499] 10.222.0.16 () {60 vars in 1322 bytes} [Mon May 23 12:37:23 2022] POST /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f/os-volume_attachments => generated 194 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:37:31.371140 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-28d754a3-c047-4550-95af-083340fd86f8 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:37:31.372252 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-28d754a3-c047-4550-95af-083340fd86f8 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:31.374112 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:31.379606 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-28d754a3-c047-4550-95af-083340fd86f8 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:31.380059 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-28d754a3-c047-4550-95af-083340fd86f8 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:31.380860 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-28d754a3-c047-4550-95af-083340fd86f8 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:31.381325 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-28d754a3-c047-4550-95af-083340fd86f8 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:31.404674 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.objects.instance [None req-28d754a3-c047-4550-95af-083340fd86f8 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lazy-loading 'flavor' on Instance uuid 64486ed1-2721-4c2a-a2fb-a96f3a82f32f {{(pid=124199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:37:31.528574 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-28d754a3-c047-4550-95af-083340fd86f8 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "POST /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f/action" status: 200 len: 32 microversion: 2.1 time: 0.162589 May 23 12:37:31.529172 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 251/500] 10.222.0.16 () {60 vars in 1277 bytes} [Mon May 23 12:37:31 2022] POST /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f/action => generated 32 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 12:37:31.540342 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-4e87a3a5-5fb0-4135-bae6-c5ed2f053000 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:31.541158 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-4e87a3a5-5fb0-4135-bae6-c5ed2f053000 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:31.547565 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4e87a3a5-5fb0-4135-bae6-c5ed2f053000 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:31.548043 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4e87a3a5-5fb0-4135-bae6-c5ed2f053000 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:31.548813 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4e87a3a5-5fb0-4135-bae6-c5ed2f053000 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:31.549256 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4e87a3a5-5fb0-4135-bae6-c5ed2f053000 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:31.771010 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-4e87a3a5-5fb0-4135-bae6-c5ed2f053000 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:31.779762 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-4e87a3a5-5fb0-4135-bae6-c5ed2f053000 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f" status: 200 len: 1735 microversion: 2.1 time: 0.245109 May 23 12:37:31.780415 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 250/501] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:31 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f => generated 1735 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:37:32.798681 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d632959d-3a09-4a40-a280-acc06f762180 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:32.799392 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d632959d-3a09-4a40-a280-acc06f762180 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:32.805662 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d632959d-3a09-4a40-a280-acc06f762180 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:32.806107 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d632959d-3a09-4a40-a280-acc06f762180 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:32.806865 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d632959d-3a09-4a40-a280-acc06f762180 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:32.807301 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d632959d-3a09-4a40-a280-acc06f762180 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:32.811226 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:32.944881 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d632959d-3a09-4a40-a280-acc06f762180 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:32.953276 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d632959d-3a09-4a40-a280-acc06f762180 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f" status: 200 len: 1735 microversion: 2.1 time: 0.159685 May 23 12:37:32.953846 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 252/502] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:32 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:37:33.970983 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-77dae1f6-91b0-4099-84cc-1e8823a21b35 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:33.971593 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-77dae1f6-91b0-4099-84cc-1e8823a21b35 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:33.978756 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-77dae1f6-91b0-4099-84cc-1e8823a21b35 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:33.979209 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-77dae1f6-91b0-4099-84cc-1e8823a21b35 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:33.979973 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-77dae1f6-91b0-4099-84cc-1e8823a21b35 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:33.980435 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-77dae1f6-91b0-4099-84cc-1e8823a21b35 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:34.116363 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-77dae1f6-91b0-4099-84cc-1e8823a21b35 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:34.124491 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-77dae1f6-91b0-4099-84cc-1e8823a21b35 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f" status: 200 len: 1735 microversion: 2.1 time: 0.157346 May 23 12:37:34.125064 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 251/503] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:33 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:37:35.142187 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b3f07afe-4485-418a-932e-46cb13298e65 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:35.142824 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-b3f07afe-4485-418a-932e-46cb13298e65 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:35.149821 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b3f07afe-4485-418a-932e-46cb13298e65 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:35.150264 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b3f07afe-4485-418a-932e-46cb13298e65 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:35.151065 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b3f07afe-4485-418a-932e-46cb13298e65 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:35.151496 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b3f07afe-4485-418a-932e-46cb13298e65 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:35.283338 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b3f07afe-4485-418a-932e-46cb13298e65 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:35.292029 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b3f07afe-4485-418a-932e-46cb13298e65 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f" status: 200 len: 1735 microversion: 2.1 time: 0.153691 May 23 12:37:35.292621 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 253/504] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:35 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:37:36.178006 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-634b7f61-271d-4634-9488-69aa8257171b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:36.179149 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-634b7f61-271d-4634-9488-69aa8257171b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:36.185697 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-634b7f61-271d-4634-9488-69aa8257171b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:36.186147 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-634b7f61-271d-4634-9488-69aa8257171b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:36.186913 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-634b7f61-271d-4634-9488-69aa8257171b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:36.187355 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-634b7f61-271d-4634-9488-69aa8257171b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:36.215726 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-634b7f61-271d-4634-9488-69aa8257171b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45/os-volume_attachments/10b86ab5-b3ed-414a-9916-79a294558267" status: 200 len: 194 microversion: 2.20 time: 0.041752 May 23 12:37:36.216328 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 252/505] 10.222.0.16 () {60 vars in 1453 bytes} [Mon May 23 12:37:36 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45/os-volume_attachments/10b86ab5-b3ed-414a-9916-79a294558267 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 12:37:36.278229 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-2d3c5340-4d71-41a9-ac1a-16607667a146 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:36.278718 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-2d3c5340-4d71-41a9-ac1a-16607667a146 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:36.285167 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2d3c5340-4d71-41a9-ac1a-16607667a146 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:36.285609 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2d3c5340-4d71-41a9-ac1a-16607667a146 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:36.286364 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2d3c5340-4d71-41a9-ac1a-16607667a146 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:36.286794 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2d3c5340-4d71-41a9-ac1a-16607667a146 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:36.309798 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-4f6ea725-3af3-484b-9e67-97c8ade83b4f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:36.310404 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-4f6ea725-3af3-484b-9e67-97c8ade83b4f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:36.316424 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4f6ea725-3af3-484b-9e67-97c8ade83b4f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:36.316881 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4f6ea725-3af3-484b-9e67-97c8ade83b4f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:36.317684 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4f6ea725-3af3-484b-9e67-97c8ade83b4f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:36.318122 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4f6ea725-3af3-484b-9e67-97c8ade83b4f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:36.417642 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.objects.instance [None req-2d3c5340-4d71-41a9-ac1a-16607667a146 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lazy-loading 'services' on Instance uuid ce37af9c-e5f8-4233-97f3-4280a2114e45 {{(pid=124199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:37:36.453085 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-4f6ea725-3af3-484b-9e67-97c8ade83b4f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:36.461162 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-4f6ea725-3af3-484b-9e67-97c8ade83b4f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f" status: 200 len: 1735 microversion: 2.1 time: 0.155237 May 23 12:37:36.461733 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 253/506] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:36 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:37:36.535714 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-2d3c5340-4d71-41a9-ac1a-16607667a146 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45/os-volume_attachments/10b86ab5-b3ed-414a-9916-79a294558267" status: 202 len: 0 microversion: 2.20 time: 0.261257 May 23 12:37:36.536816 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 254/507] 10.222.0.16 () {60 vars in 1456 bytes} [Mon May 23 12:37:36 2022] DELETE /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45/os-volume_attachments/10b86ab5-b3ed-414a-9916-79a294558267 => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 23 12:37:36.545558 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-f1c894ac-431e-4c0a-bb76-92a699e5da9f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:36.546582 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-f1c894ac-431e-4c0a-bb76-92a699e5da9f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:36.552787 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f1c894ac-431e-4c0a-bb76-92a699e5da9f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:36.553240 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f1c894ac-431e-4c0a-bb76-92a699e5da9f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:36.554262 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f1c894ac-431e-4c0a-bb76-92a699e5da9f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:36.554743 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f1c894ac-431e-4c0a-bb76-92a699e5da9f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:36.558698 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:36.592192 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-f1c894ac-431e-4c0a-bb76-92a699e5da9f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050558 May 23 12:37:36.592761 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 254/508] 10.222.0.16 () {60 vars in 1342 bytes} [Mon May 23 12:37:36 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 12:37:37.478725 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-51dd6114-1056-4f03-bfba-65fde7b1f297 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:37.479458 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-51dd6114-1056-4f03-bfba-65fde7b1f297 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:37.486481 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-51dd6114-1056-4f03-bfba-65fde7b1f297 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:37.486936 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-51dd6114-1056-4f03-bfba-65fde7b1f297 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:37.487717 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-51dd6114-1056-4f03-bfba-65fde7b1f297 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:37.488162 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-51dd6114-1056-4f03-bfba-65fde7b1f297 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:37.604439 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-6959066d-a94a-4896-b2f3-076e92bc466b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:37.605461 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-6959066d-a94a-4896-b2f3-076e92bc466b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:37.612025 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6959066d-a94a-4896-b2f3-076e92bc466b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:37.612602 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6959066d-a94a-4896-b2f3-076e92bc466b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:37.613443 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6959066d-a94a-4896-b2f3-076e92bc466b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:37.613935 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6959066d-a94a-4896-b2f3-076e92bc466b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:37.621585 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-51dd6114-1056-4f03-bfba-65fde7b1f297 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:37.629960 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-51dd6114-1056-4f03-bfba-65fde7b1f297 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f" status: 200 len: 1735 microversion: 2.1 time: 0.155512 May 23 12:37:37.630547 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 255/509] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:37 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:37:37.645382 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-6959066d-a94a-4896-b2f3-076e92bc466b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045700 May 23 12:37:37.646024 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 255/510] 10.222.0.16 () {60 vars in 1342 bytes} [Mon May 23 12:37:37 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:37:37.704099 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c0662e52-5437-40c4-a2d9-f2000fcc1d86 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:37.704641 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c0662e52-5437-40c4-a2d9-f2000fcc1d86 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:37.711086 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c0662e52-5437-40c4-a2d9-f2000fcc1d86 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:37.711550 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c0662e52-5437-40c4-a2d9-f2000fcc1d86 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:37.712512 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c0662e52-5437-40c4-a2d9-f2000fcc1d86 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:37.712946 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c0662e52-5437-40c4-a2d9-f2000fcc1d86 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:37.737639 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c0662e52-5437-40c4-a2d9-f2000fcc1d86 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Going to try to terminate instance {{(pid=124199) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 12:37:37.815063 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c0662e52-5437-40c4-a2d9-f2000fcc1d86 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 204 len: 0 microversion: 2.20 time: 0.114694 May 23 12:37:37.815567 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 256/511] 10.222.0.16 () {60 vars in 1279 bytes} [Mon May 23 12:37:37 2022] DELETE /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 23 12:37:37.824900 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-739c4624-a4bd-40bc-9a22-dc11f2bd7424 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:37.825510 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-739c4624-a4bd-40bc-9a22-dc11f2bd7424 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:37.831707 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-739c4624-a4bd-40bc-9a22-dc11f2bd7424 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:37.832189 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-739c4624-a4bd-40bc-9a22-dc11f2bd7424 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:37.832967 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-739c4624-a4bd-40bc-9a22-dc11f2bd7424 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:37.833404 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-739c4624-a4bd-40bc-9a22-dc11f2bd7424 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:37.967793 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-739c4624-a4bd-40bc-9a22-dc11f2bd7424 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:37.975874 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-739c4624-a4bd-40bc-9a22-dc11f2bd7424 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:37.978025 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-739c4624-a4bd-40bc-9a22-dc11f2bd7424 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:37.979185 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-739c4624-a4bd-40bc-9a22-dc11f2bd7424 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1725 microversion: 2.20 time: 0.158618 May 23 12:37:37.979751 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 256/512] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:37:37 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:37:38.649485 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-2986da3a-d3d7-4f07-bef1-ca54c4080fb2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:38.650420 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-2986da3a-d3d7-4f07-bef1-ca54c4080fb2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:38.657464 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2986da3a-d3d7-4f07-bef1-ca54c4080fb2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:38.657993 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2986da3a-d3d7-4f07-bef1-ca54c4080fb2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:38.658914 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2986da3a-d3d7-4f07-bef1-ca54c4080fb2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:38.659348 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2986da3a-d3d7-4f07-bef1-ca54c4080fb2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:38.788027 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-2986da3a-d3d7-4f07-bef1-ca54c4080fb2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:38.796436 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-2986da3a-d3d7-4f07-bef1-ca54c4080fb2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f" status: 200 len: 1735 microversion: 2.1 time: 0.151921 May 23 12:37:38.797957 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 257/513] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:38 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:37:38.999829 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-293f3781-43e1-49f4-a1fa-1c1697af804d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:39.000587 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-293f3781-43e1-49f4-a1fa-1c1697af804d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:39.007826 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-293f3781-43e1-49f4-a1fa-1c1697af804d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:39.009102 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-293f3781-43e1-49f4-a1fa-1c1697af804d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:39.009891 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-293f3781-43e1-49f4-a1fa-1c1697af804d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:39.010339 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-293f3781-43e1-49f4-a1fa-1c1697af804d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:39.141599 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-293f3781-43e1-49f4-a1fa-1c1697af804d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:39.149961 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-293f3781-43e1-49f4-a1fa-1c1697af804d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:39.151470 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-293f3781-43e1-49f4-a1fa-1c1697af804d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:39.152646 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-293f3781-43e1-49f4-a1fa-1c1697af804d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1725 microversion: 2.20 time: 0.158123 May 23 12:37:39.153197 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 257/514] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:37:38 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:37:39.815006 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-be3cb826-d22c-47a8-887d-e9a1c4e2b37c tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:39.815619 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-be3cb826-d22c-47a8-887d-e9a1c4e2b37c tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:39.822431 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-be3cb826-d22c-47a8-887d-e9a1c4e2b37c tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:39.822885 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-be3cb826-d22c-47a8-887d-e9a1c4e2b37c tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:39.823658 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-be3cb826-d22c-47a8-887d-e9a1c4e2b37c tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:39.824099 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-be3cb826-d22c-47a8-887d-e9a1c4e2b37c tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:40.050258 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-be3cb826-d22c-47a8-887d-e9a1c4e2b37c tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:40.058856 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-be3cb826-d22c-47a8-887d-e9a1c4e2b37c tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f" status: 200 len: 1735 microversion: 2.1 time: 0.247741 May 23 12:37:40.059435 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 258/515] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:39 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f => generated 1735 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:37:40.171208 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-cce48ba6-652a-45e5-8b20-e73a5f15e1a8 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:40.171863 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-cce48ba6-652a-45e5-8b20-e73a5f15e1a8 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:40.174404 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:40.180882 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-cce48ba6-652a-45e5-8b20-e73a5f15e1a8 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:40.181332 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-cce48ba6-652a-45e5-8b20-e73a5f15e1a8 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:40.182092 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-cce48ba6-652a-45e5-8b20-e73a5f15e1a8 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:40.182526 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-cce48ba6-652a-45e5-8b20-e73a5f15e1a8 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:40.381539 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-cce48ba6-652a-45e5-8b20-e73a5f15e1a8 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:40.390406 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-cce48ba6-652a-45e5-8b20-e73a5f15e1a8 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:40.392281 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-cce48ba6-652a-45e5-8b20-e73a5f15e1a8 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:40.393471 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-cce48ba6-652a-45e5-8b20-e73a5f15e1a8 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 200 len: 1725 microversion: 2.20 time: 0.226292 May 23 12:37:40.394020 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 258/516] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:37:40 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 1725 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:37:40.713192 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-d611e866-347d-45ac-acdc-95d402255a87 req-6eeab2f8-9b73-45b2-9f7b-01f0ac2b24bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce37af9c-e5f8-4233-97f3-4280a2114e45", "name": "network-vif-deleted", "tag": "357ce430-3b90-4a7c-b2f3-c2ee303501e4"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:37:40.721846 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-d611e866-347d-45ac-acdc-95d402255a87 req-6eeab2f8-9b73-45b2-9f7b-01f0ac2b24bd service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:40.722340 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-d611e866-347d-45ac-acdc-95d402255a87 req-6eeab2f8-9b73-45b2-9f7b-01f0ac2b24bd service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:40.733864 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-d611e866-347d-45ac-acdc-95d402255a87 req-6eeab2f8-9b73-45b2-9f7b-01f0ac2b24bd service nova] Creating event network-vif-deleted:357ce430-3b90-4a7c-b2f3-c2ee303501e4 for instance ce37af9c-e5f8-4233-97f3-4280a2114e45 on hv-cinder-83699 May 23 12:37:40.739670 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-d611e866-347d-45ac-acdc-95d402255a87 req-6eeab2f8-9b73-45b2-9f7b-01f0ac2b24bd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030686 May 23 12:37:40.740727 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 259/517] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:37:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:37:41.076823 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-f992801d-9795-4800-98c6-ebf7a6b5889d tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:41.077695 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-f992801d-9795-4800-98c6-ebf7a6b5889d tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:41.083976 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f992801d-9795-4800-98c6-ebf7a6b5889d tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:41.084458 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f992801d-9795-4800-98c6-ebf7a6b5889d tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:41.085242 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f992801d-9795-4800-98c6-ebf7a6b5889d tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:41.085681 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f992801d-9795-4800-98c6-ebf7a6b5889d tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:41.250236 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-f992801d-9795-4800-98c6-ebf7a6b5889d tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:41.259280 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-f992801d-9795-4800-98c6-ebf7a6b5889d tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f" status: 200 len: 1735 microversion: 2.1 time: 0.186383 May 23 12:37:41.260108 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 259/518] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:41 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f => generated 1735 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:37:41.413409 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-5f20063f-a324-4287-8ce6-ae6d166fa93d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:41.414118 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-5f20063f-a324-4287-8ce6-ae6d166fa93d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:41.421285 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5f20063f-a324-4287-8ce6-ae6d166fa93d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:41.421734 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5f20063f-a324-4287-8ce6-ae6d166fa93d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:41.422515 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5f20063f-a324-4287-8ce6-ae6d166fa93d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:41.422964 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5f20063f-a324-4287-8ce6-ae6d166fa93d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:41.439958 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.wsgi [None req-5f20063f-a324-4287-8ce6-ae6d166fa93d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] HTTP exception thrown: Instance ce37af9c-e5f8-4233-97f3-4280a2114e45 could not be found. May 23 12:37:41.441624 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-5f20063f-a324-4287-8ce6-ae6d166fa93d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Request method failure captured: May 23 12:37:41.441624 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: request: GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 HTTP/1.1 May 23 12:37:41.441624 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept: application/json May 23 12:37:41.441624 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept-Encoding: identity May 23 12:37:41.441624 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Connection: close May 23 12:37:41.441624 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Length: 0 May 23 12:37:41.441624 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Type: application/json May 23 12:37:41.441624 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Host: 10.222.0.16 May 23 12:37:41.441624 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Openstack-System-Scope: None May 23 12:37:41.441624 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: User-Agent: python-urllib3/1.26.9 May 23 12:37:41.441624 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Auth-Token: gAAAAABii38UOn58rNAdiNYAPjH0omFFBsaNaO8_pzVIuQn4neM6lIxk4S5ERtpR-eO0Z7jfaS2HOB2FTPvEWVBv6qhuXlTO9wLieACj5bJof4If4yf5xtcblLcy8Aiwr6POOlbjhYtACwGg5Koy8rvnyA52MZqFVQGqLr0AWRd9UPIeyfBiuuU May 23 12:37:41.441624 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Id: None May 23 12:37:41.441624 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Name: None May 23 12:37:41.441624 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Identity-Status: Confirmed May 23 12:37:41.441624 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Is-Admin-Project: True May 23 12:37:41.441624 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Openstack-Nova-Api-Version: 2.20 May 23 12:37:41.441624 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Id: default May 23 12:37:41.441624 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Name: Default May 23 12:37:41.441624 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Id: 0502b9ef01e2460893cfc855d44db0c7 May 23 12:37:41.441624 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-457595946 May 23 12:37:41.441624 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Role: member,reader May 23 12:37:41.441624 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Roles: member,reader May 23 12:37:41.443327 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0502b9ef01e2460893cfc855d44db0c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0502b9ef01e2460893cfc855d44db0c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0502b9ef01e2460893cfc855d44db0c7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0502b9ef01e2460893cfc855d44db0c7"}]}] May 23 12:37:41.443327 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant: tempest-AttachVolumeShelveTestJSON-457595946 May 23 12:37:41.443327 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Id: 0502b9ef01e2460893cfc855d44db0c7 May 23 12:37:41.443327 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-457595946 May 23 12:37:41.443327 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User: tempest-AttachVolumeShelveTestJSON-457595946-project May 23 12:37:41.443327 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Id: default May 23 12:37:41.443327 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Name: Default May 23 12:37:41.443327 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Id: 851454212d14438d80bf8e193fea268e May 23 12:37:41.443327 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Name: tempest-AttachVolumeShelveTestJSON-457595946-project May 23 12:37:41.443327 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: method: > May 23 12:37:41.443327 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: exception: Instance ce37af9c-e5f8-4233-97f3-4280a2114e45 could not be found. May 23 12:37:41.443327 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: action_args: {'id': 'ce37af9c-e5f8-4233-97f3-4280a2114e45'} May 23 12:37:41.444486 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:37:41.444486 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:37:41.444486 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:37:41.444486 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:37:41.444486 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:37:41.444486 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:37:41.444486 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:37:41.444486 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:37:41.444486 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:37:41.444486 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:37:41.444486 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce37af9c-e5f8-4233-97f3-4280a2114e45 could not be found. May 23 12:37:41.444486 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:37:41.444486 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:37:41.444486 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:37:41.444486 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:37:41.444486 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:37:41.444486 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:37:41.444486 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:37:41.444486 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:37:41.444486 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:37:41.446156 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:37:41.446156 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:37:41.446156 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:37:41.446156 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:37:41.446156 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:37:41.446156 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:37:41.446156 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:37:41.446156 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce37af9c-e5f8-4233-97f3-4280a2114e45 could not be found. May 23 12:37:41.446156 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:37:41.446156 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:37:41.446156 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:37:41.446156 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:37:41.446156 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:37:41.446156 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:37:41.446156 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:37:41.446156 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:37:41.446156 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce37af9c-e5f8-4233-97f3-4280a2114e45 could not be found. May 23 12:37:41.446156 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:37:41.447675 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-5f20063f-a324-4287-8ce6-ae6d166fa93d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Returning 404 to user: Instance ce37af9c-e5f8-4233-97f3-4280a2114e45 could not be found. {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:37:41.447675 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-5f20063f-a324-4287-8ce6-ae6d166fa93d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 404 len: 111 microversion: 2.20 time: 0.034494 May 23 12:37:41.448079 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 260/519] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:37:41 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 12:37:41.451993 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-6c9855c0-60ea-48d8-95c0-4e08a63661dd tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '.version_select at 0x7f095c95ee50>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:41.471669 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-6c9855c0-60ea-48d8-95c0-4e08a63661dd tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1696254475" status: 204 len: 0 microversion: 2.20 time: 0.023389 May 23 12:37:41.472280 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 260/520] 10.222.0.16 () {60 vars in 1261 bytes} [Mon May 23 12:37:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1696254475 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 23 12:37:42.125517 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-02b16b2e-9848-44c6-ae71-9338a1913e86 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Action: 'create', calling method: .version_select at 0x7f095d383d30>, body: {"keypair": {"name": "tempest-keypair-365135125", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPHg0Lqy00gJy+OVgg9ZNEm5gTdragbs+KbADW6u6w3qH/BYKo78eyg2rEdJuBBxXKXXGGwp6MSFW9Z10pOdl2XbOsP+KbcG7cTPYGaikV6cyJ6/7s+513o0kJQsIo8VLw=="}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:37:42.140041 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-02b16b2e-9848-44c6-ae71-9338a1913e86 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Getting quotas for project 0502b9ef01e2460893cfc855d44db0c7. Resources: {'key_pairs'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:37:42.143808 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-02b16b2e-9848-44c6-ae71-9338a1913e86 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Getting quotas for user 851454212d14438d80bf8e193fea268e and project 0502b9ef01e2460893cfc855d44db0c7. Resources: {'key_pairs'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:37:42.165587 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-02b16b2e-9848-44c6-ae71-9338a1913e86 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.044019 May 23 12:37:42.166161 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 261/521] 10.222.0.16 () {62 vars in 1199 bytes} [Mon May 23 12:37:42 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 45 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 23 12:37:42.277738 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-8ea52715-a6ee-40d5-bcc7-7633d44f0d71 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:42.278347 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-8ea52715-a6ee-40d5-bcc7-7633d44f0d71 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:42.284384 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8ea52715-a6ee-40d5-bcc7-7633d44f0d71 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:42.284831 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8ea52715-a6ee-40d5-bcc7-7633d44f0d71 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:42.285599 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8ea52715-a6ee-40d5-bcc7-7633d44f0d71 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:42.286032 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8ea52715-a6ee-40d5-bcc7-7633d44f0d71 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:42.421851 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-8ea52715-a6ee-40d5-bcc7-7633d44f0d71 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:42.430207 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-8ea52715-a6ee-40d5-bcc7-7633d44f0d71 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f" status: 200 len: 1735 microversion: 2.1 time: 0.157612 May 23 12:37:42.430794 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 261/522] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:42 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:37:43.449810 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-67606956-8014-4b40-a18c-b9af50c15847 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:43.450433 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-67606956-8014-4b40-a18c-b9af50c15847 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:43.456756 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-67606956-8014-4b40-a18c-b9af50c15847 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:43.457212 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-67606956-8014-4b40-a18c-b9af50c15847 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:43.457992 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-67606956-8014-4b40-a18c-b9af50c15847 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:43.458434 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-67606956-8014-4b40-a18c-b9af50c15847 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:43.479978 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-99aa464f-63c1-440b-8af2-14ed297ee039 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2013540341", "imageRef": "bb11dfa4-2977-4163-8237-78c871c8437f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3322fe8c-081c-4cfd-b180-198330997eff"}], "security_groups": [{"name": "tempest-securitygroup--1616261239"}], "key_name": "tempest-keypair-365135125", "user_data": "}} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:37:43.618124 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.network.neutron [None req-99aa464f-63c1-440b-8af2-14ed297ee039 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] validate_networks() for [('3322fe8c-081c-4cfd-b180-198330997eff', None, None, None, None, None)] {{(pid=124200) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 12:37:43.623712 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-67606956-8014-4b40-a18c-b9af50c15847 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:43.632494 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-67606956-8014-4b40-a18c-b9af50c15847 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f" status: 200 len: 1735 microversion: 2.1 time: 0.187601 May 23 12:37:43.633255 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 262/523] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:43 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f => generated 1735 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:37:43.990101 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-99aa464f-63c1-440b-8af2-14ed297ee039 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Flavor limits 0:0:0 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 12:37:43.990520 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-99aa464f-63c1-440b-8af2-14ed297ee039 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Image limits 0:0:0 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 12:37:43.991060 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-99aa464f-63c1-440b-8af2-14ed297ee039 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Flavor pref 0:0:0 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 12:37:43.991431 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-99aa464f-63c1-440b-8af2-14ed297ee039 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Image pref 0:0:0 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 12:37:43.991819 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-99aa464f-63c1-440b-8af2-14ed297ee039 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 12:37:44.000745 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-99aa464f-63c1-440b-8af2-14ed297ee039 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:44.001189 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-99aa464f-63c1-440b-8af2-14ed297ee039 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:44.001989 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-99aa464f-63c1-440b-8af2-14ed297ee039 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:44.002427 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-99aa464f-63c1-440b-8af2-14ed297ee039 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:44.019209 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.quota [None req-99aa464f-63c1-440b-8af2-14ed297ee039 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Getting quotas for project 0502b9ef01e2460893cfc855d44db0c7. Resources: {'instances', 'cores', 'ram'} {{(pid=124200) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:37:44.023299 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.quota [None req-99aa464f-63c1-440b-8af2-14ed297ee039 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Getting quotas for user 851454212d14438d80bf8e193fea268e and project 0502b9ef01e2460893cfc855d44db0c7. Resources: {'instances', 'cores', 'ram'} {{(pid=124200) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:37:44.035208 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-99aa464f-63c1-440b-8af2-14ed297ee039 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Going to run 1 instances... {{(pid=124200) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 12:37:44.037518 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-99aa464f-63c1-440b-8af2-14ed297ee039 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb11dfa4-2977-4163-8237-78c871c8437f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124200) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 12:37:44.086874 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-99aa464f-63c1-440b-8af2-14ed297ee039 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.611027 May 23 12:37:44.087411 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 262/524] 10.222.0.16 () {62 vars in 1187 bytes} [Mon May 23 12:37:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 23 12:37:44.097423 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-2fe79d6d-d876-4493-9873-cb27038eb091 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:44.098032 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-2fe79d6d-d876-4493-9873-cb27038eb091 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:44.152621 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-2fe79d6d-d876-4493-9873-cb27038eb091 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:44.159733 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-2fe79d6d-d876-4493-9873-cb27038eb091 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:44.161261 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-2fe79d6d-d876-4493-9873-cb27038eb091 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:44.162352 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-2fe79d6d-d876-4493-9873-cb27038eb091 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1281 microversion: 2.20 time: 0.068867 May 23 12:37:44.163064 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 263/525] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:37:44 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1281 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:37:44.654407 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-b68812ed-e712-4e08-a886-f47199a589f2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:44.655010 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-b68812ed-e712-4e08-a886-f47199a589f2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:44.662825 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b68812ed-e712-4e08-a886-f47199a589f2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:44.663536 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b68812ed-e712-4e08-a886-f47199a589f2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:44.665173 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b68812ed-e712-4e08-a886-f47199a589f2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:44.665776 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b68812ed-e712-4e08-a886-f47199a589f2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:44.807479 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-b68812ed-e712-4e08-a886-f47199a589f2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:44.815449 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-b68812ed-e712-4e08-a886-f47199a589f2 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f" status: 200 len: 1735 microversion: 2.1 time: 0.168618 May 23 12:37:44.816013 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 263/526] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:44 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:37:45.181941 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-9ffb532b-1946-4591-bd43-9374d37db1ce tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:45.182548 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-9ffb532b-1946-4591-bd43-9374d37db1ce tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:45.189466 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9ffb532b-1946-4591-bd43-9374d37db1ce tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:45.190299 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9ffb532b-1946-4591-bd43-9374d37db1ce tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:45.191437 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9ffb532b-1946-4591-bd43-9374d37db1ce tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:45.192050 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9ffb532b-1946-4591-bd43-9374d37db1ce tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:45.325424 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9ffb532b-1946-4591-bd43-9374d37db1ce tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:45.333592 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9ffb532b-1946-4591-bd43-9374d37db1ce tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:45.335082 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9ffb532b-1946-4591-bd43-9374d37db1ce tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:45.336808 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-9ffb532b-1946-4591-bd43-9374d37db1ce tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1339 microversion: 2.20 time: 0.159104 May 23 12:37:45.337446 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 264/527] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:37:45 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1339 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:37:45.834002 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-9050ed12-df2a-4aaf-a578-212fc89973df tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:45.835329 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-9050ed12-df2a-4aaf-a578-212fc89973df tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:45.843626 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9050ed12-df2a-4aaf-a578-212fc89973df tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:45.844450 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9050ed12-df2a-4aaf-a578-212fc89973df tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:45.845469 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9050ed12-df2a-4aaf-a578-212fc89973df tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:45.846278 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9050ed12-df2a-4aaf-a578-212fc89973df tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:46.276145 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-9050ed12-df2a-4aaf-a578-212fc89973df tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:46.289137 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-9050ed12-df2a-4aaf-a578-212fc89973df tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f" status: 200 len: 1735 microversion: 2.1 time: 0.459200 May 23 12:37:46.290324 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 264/528] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:45 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f => generated 1735 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:37:46.355311 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-ef901c98-918b-404e-94af-9c4d7f5c8273 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:46.355929 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-ef901c98-918b-404e-94af-9c4d7f5c8273 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:46.362623 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ef901c98-918b-404e-94af-9c4d7f5c8273 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:46.363066 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ef901c98-918b-404e-94af-9c4d7f5c8273 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:46.364036 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ef901c98-918b-404e-94af-9c4d7f5c8273 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:46.364501 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ef901c98-918b-404e-94af-9c4d7f5c8273 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:46.577824 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-ef901c98-918b-404e-94af-9c4d7f5c8273 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:46.585748 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-ef901c98-918b-404e-94af-9c4d7f5c8273 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:46.587294 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-ef901c98-918b-404e-94af-9c4d7f5c8273 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:46.588420 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-ef901c98-918b-404e-94af-9c4d7f5c8273 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1407 microversion: 2.20 time: 0.237255 May 23 12:37:46.588976 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 265/529] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:37:46 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1407 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:37:46.958890 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-c4616981-238c-4854-833f-1bf72c4d7bf5 req-56d7c8d3-9f6e-4631-a438-7836750bc414 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40320b2c-6137-4266-b3b6-fb76f3d6d654", "tag": "c581b4f8-de6e-4314-a04e-aca7063e49e5"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:37:46.976160 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-c4616981-238c-4854-833f-1bf72c4d7bf5 req-56d7c8d3-9f6e-4631-a438-7836750bc414 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:46.977543 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-c4616981-238c-4854-833f-1bf72c4d7bf5 req-56d7c8d3-9f6e-4631-a438-7836750bc414 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:46.997299 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-c4616981-238c-4854-833f-1bf72c4d7bf5 req-56d7c8d3-9f6e-4631-a438-7836750bc414 service nova] Creating event network-changed:c581b4f8-de6e-4314-a04e-aca7063e49e5 for instance 40320b2c-6137-4266-b3b6-fb76f3d6d654 on hv-cinder-83699 May 23 12:37:47.005478 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-c4616981-238c-4854-833f-1bf72c4d7bf5 req-56d7c8d3-9f6e-4631-a438-7836750bc414 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052579 May 23 12:37:47.006731 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 265/530] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:37:47.313367 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-2c87547a-e6ac-4e50-9264-1437dc3c4c32 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:47.313989 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-2c87547a-e6ac-4e50-9264-1437dc3c4c32 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:47.320419 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2c87547a-e6ac-4e50-9264-1437dc3c4c32 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:47.321069 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2c87547a-e6ac-4e50-9264-1437dc3c4c32 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:47.322013 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2c87547a-e6ac-4e50-9264-1437dc3c4c32 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:47.322447 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2c87547a-e6ac-4e50-9264-1437dc3c4c32 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:47.482002 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-2c87547a-e6ac-4e50-9264-1437dc3c4c32 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:47.490419 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-2c87547a-e6ac-4e50-9264-1437dc3c4c32 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f" status: 200 len: 1735 microversion: 2.1 time: 0.180937 May 23 12:37:47.491020 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 266/531] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:47 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:37:47.607049 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-512df81a-455f-4726-b64e-ebafa9a8c2a6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:47.607735 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-512df81a-455f-4726-b64e-ebafa9a8c2a6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:47.614495 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-512df81a-455f-4726-b64e-ebafa9a8c2a6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:47.614981 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-512df81a-455f-4726-b64e-ebafa9a8c2a6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:47.615751 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-512df81a-455f-4726-b64e-ebafa9a8c2a6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:47.616193 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-512df81a-455f-4726-b64e-ebafa9a8c2a6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:47.767420 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-512df81a-455f-4726-b64e-ebafa9a8c2a6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:47.776205 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-512df81a-455f-4726-b64e-ebafa9a8c2a6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:47.777734 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-512df81a-455f-4726-b64e-ebafa9a8c2a6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:47.778824 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-512df81a-455f-4726-b64e-ebafa9a8c2a6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1407 microversion: 2.20 time: 0.176068 May 23 12:37:47.779388 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 266/532] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:37:47 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:37:48.508944 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-71262833-a3e4-4ea3-a18e-ef256e4c1d0c tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:48.509783 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-71262833-a3e4-4ea3-a18e-ef256e4c1d0c tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:48.516193 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-71262833-a3e4-4ea3-a18e-ef256e4c1d0c tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:48.516659 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-71262833-a3e4-4ea3-a18e-ef256e4c1d0c tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:48.517433 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-71262833-a3e4-4ea3-a18e-ef256e4c1d0c tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:48.517870 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-71262833-a3e4-4ea3-a18e-ef256e4c1d0c tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:48.657066 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-71262833-a3e4-4ea3-a18e-ef256e4c1d0c tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:48.665682 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-71262833-a3e4-4ea3-a18e-ef256e4c1d0c tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f" status: 200 len: 1735 microversion: 2.1 time: 0.161315 May 23 12:37:48.667079 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 267/533] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:48 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:37:48.797549 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-0176eb39-813f-42d5-a4b1-742a5a9d2d07 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:48.798154 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-0176eb39-813f-42d5-a4b1-742a5a9d2d07 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:48.804586 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0176eb39-813f-42d5-a4b1-742a5a9d2d07 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:48.805820 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0176eb39-813f-42d5-a4b1-742a5a9d2d07 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:48.806735 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0176eb39-813f-42d5-a4b1-742a5a9d2d07 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:48.807168 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0176eb39-813f-42d5-a4b1-742a5a9d2d07 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:48.940885 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-0176eb39-813f-42d5-a4b1-742a5a9d2d07 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:48.949410 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-0176eb39-813f-42d5-a4b1-742a5a9d2d07 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:48.950980 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-0176eb39-813f-42d5-a4b1-742a5a9d2d07 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:48.952129 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-0176eb39-813f-42d5-a4b1-742a5a9d2d07 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1407 microversion: 2.20 time: 0.158466 May 23 12:37:48.952997 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 267/534] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:37:48 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:37:49.683060 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c66a3dfa-75ec-4a28-af5b-98f87226d085 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:49.683675 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c66a3dfa-75ec-4a28-af5b-98f87226d085 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:49.690252 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c66a3dfa-75ec-4a28-af5b-98f87226d085 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:49.690697 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c66a3dfa-75ec-4a28-af5b-98f87226d085 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:49.691530 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c66a3dfa-75ec-4a28-af5b-98f87226d085 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:49.691970 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c66a3dfa-75ec-4a28-af5b-98f87226d085 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:49.832027 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c66a3dfa-75ec-4a28-af5b-98f87226d085 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:49.840788 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c66a3dfa-75ec-4a28-af5b-98f87226d085 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f" status: 200 len: 1735 microversion: 2.1 time: 0.161787 May 23 12:37:49.841353 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 268/535] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:49 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:37:49.973332 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-e9549e77-5ecb-4932-b7f2-86ecc1fda12f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:49.973961 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-e9549e77-5ecb-4932-b7f2-86ecc1fda12f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:49.981776 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e9549e77-5ecb-4932-b7f2-86ecc1fda12f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:49.982259 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e9549e77-5ecb-4932-b7f2-86ecc1fda12f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:49.983181 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e9549e77-5ecb-4932-b7f2-86ecc1fda12f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:49.983629 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e9549e77-5ecb-4932-b7f2-86ecc1fda12f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:50.194420 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-e9549e77-5ecb-4932-b7f2-86ecc1fda12f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:50.203660 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-e9549e77-5ecb-4932-b7f2-86ecc1fda12f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:50.205693 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-e9549e77-5ecb-4932-b7f2-86ecc1fda12f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:50.206409 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-e9549e77-5ecb-4932-b7f2-86ecc1fda12f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1407 microversion: 2.20 time: 0.238777 May 23 12:37:50.206968 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 268/536] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:37:49 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1407 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:37:50.858276 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-3e076ab0-ac37-4a6f-a96e-74395a5576cd tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:50.859065 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-3e076ab0-ac37-4a6f-a96e-74395a5576cd tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:50.866026 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3e076ab0-ac37-4a6f-a96e-74395a5576cd tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:50.866521 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3e076ab0-ac37-4a6f-a96e-74395a5576cd tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:50.867860 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3e076ab0-ac37-4a6f-a96e-74395a5576cd tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:50.868357 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3e076ab0-ac37-4a6f-a96e-74395a5576cd tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:51.003163 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-3e076ab0-ac37-4a6f-a96e-74395a5576cd tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:51.005463 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:51.013861 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-3e076ab0-ac37-4a6f-a96e-74395a5576cd tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f" status: 200 len: 1735 microversion: 2.1 time: 0.159753 May 23 12:37:51.014425 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 269/537] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:50 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:37:51.224894 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-197c5087-92cc-4aea-82d3-370dee6aae18 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:51.225444 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-197c5087-92cc-4aea-82d3-370dee6aae18 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:51.232687 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-197c5087-92cc-4aea-82d3-370dee6aae18 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:51.233132 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-197c5087-92cc-4aea-82d3-370dee6aae18 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:51.233888 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-197c5087-92cc-4aea-82d3-370dee6aae18 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:51.234318 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-197c5087-92cc-4aea-82d3-370dee6aae18 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:51.372976 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-197c5087-92cc-4aea-82d3-370dee6aae18 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:51.381171 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-197c5087-92cc-4aea-82d3-370dee6aae18 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:51.382660 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-197c5087-92cc-4aea-82d3-370dee6aae18 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:51.384154 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-197c5087-92cc-4aea-82d3-370dee6aae18 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1407 microversion: 2.20 time: 0.163228 May 23 12:37:51.384755 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 269/538] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:37:51 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:37:52.032559 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-cda911f2-85d0-40fa-8d1c-2a9ff8095196 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:52.033443 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-cda911f2-85d0-40fa-8d1c-2a9ff8095196 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:52.043810 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cda911f2-85d0-40fa-8d1c-2a9ff8095196 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:52.044642 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cda911f2-85d0-40fa-8d1c-2a9ff8095196 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:52.045609 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cda911f2-85d0-40fa-8d1c-2a9ff8095196 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:52.046275 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cda911f2-85d0-40fa-8d1c-2a9ff8095196 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:52.047114 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-063c34ea-3c67-4adb-9dbe-1d6b8aa66b41 req-413b5f51-2367-49fc-b2cc-6ac575de7a03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40320b2c-6137-4266-b3b6-fb76f3d6d654", "name": "network-vif-plugged", "status": "completed", "tag": "c581b4f8-de6e-4314-a04e-aca7063e49e5"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:37:52.056405 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-063c34ea-3c67-4adb-9dbe-1d6b8aa66b41 req-413b5f51-2367-49fc-b2cc-6ac575de7a03 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:52.056865 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-063c34ea-3c67-4adb-9dbe-1d6b8aa66b41 req-413b5f51-2367-49fc-b2cc-6ac575de7a03 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:52.072434 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-063c34ea-3c67-4adb-9dbe-1d6b8aa66b41 req-413b5f51-2367-49fc-b2cc-6ac575de7a03 service nova] Creating event network-vif-plugged:c581b4f8-de6e-4314-a04e-aca7063e49e5 for instance 40320b2c-6137-4266-b3b6-fb76f3d6d654 on hv-cinder-83699 May 23 12:37:52.082501 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-063c34ea-3c67-4adb-9dbe-1d6b8aa66b41 req-413b5f51-2367-49fc-b2cc-6ac575de7a03 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038709 May 23 12:37:52.083682 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 270/539] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:37:52.200749 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-cda911f2-85d0-40fa-8d1c-2a9ff8095196 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:52.209104 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-cda911f2-85d0-40fa-8d1c-2a9ff8095196 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f" status: 200 len: 1715 microversion: 2.1 time: 0.181247 May 23 12:37:52.209676 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 270/540] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:52 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f => generated 1715 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:37:52.316708 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-e94834f1-a72a-4827-b488-4c020fc89afe tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:52.317395 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-e94834f1-a72a-4827-b488-4c020fc89afe tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:52.324264 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e94834f1-a72a-4827-b488-4c020fc89afe tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:52.324727 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e94834f1-a72a-4827-b488-4c020fc89afe tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:52.325498 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e94834f1-a72a-4827-b488-4c020fc89afe tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:52.325939 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e94834f1-a72a-4827-b488-4c020fc89afe tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:52.402282 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-7af639f7-dc1f-44a3-bc31-43c78981202a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:52.403076 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-7af639f7-dc1f-44a3-bc31-43c78981202a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:52.408337 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.wsgi [None req-e94834f1-a72a-4827-b488-4c020fc89afe tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] HTTP exception thrown: Cannot 'detach_volume' instance 64486ed1-2721-4c2a-a2fb-a96f3a82f32f while it is in vm_state rescued May 23 12:37:52.409500 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7af639f7-dc1f-44a3-bc31-43c78981202a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:52.409952 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7af639f7-dc1f-44a3-bc31-43c78981202a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:52.410316 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-e94834f1-a72a-4827-b488-4c020fc89afe tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Request method failure captured: May 23 12:37:52.410316 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: request: DELETE /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f/os-volume_attachments/23e14746-9a92-488b-94ab-ebfe7513e9da HTTP/1.1 May 23 12:37:52.410316 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept: application/json May 23 12:37:52.410316 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept-Encoding: identity May 23 12:37:52.410316 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Connection: close May 23 12:37:52.410316 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Length: 0 May 23 12:37:52.410316 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Type: application/json May 23 12:37:52.410316 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Host: 10.222.0.16 May 23 12:37:52.410316 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Openstack-System-Scope: None May 23 12:37:52.410316 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: User-Agent: python-urllib3/1.26.9 May 23 12:37:52.410316 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Auth-Token: gAAAAABii38iJaeoogG5HQkTeh9nj0rGOP9VyOFedVQ4rI22IsjBVAneC4_uWbO22G3kbdcZRA9jPU4ejUnxmNU5jfy_2y_etQMmPY5AMnbyQR_IV7orew0xRV9LzMqa87mHc9D9zuVTwg73oa7Mf_pjol8tTgwzZ3VnGtE-MhQByJ8OewzppZw May 23 12:37:52.410316 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Id: None May 23 12:37:52.410316 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Name: None May 23 12:37:52.410316 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Identity-Status: Confirmed May 23 12:37:52.410316 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Is-Admin-Project: True May 23 12:37:52.410316 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Id: default May 23 12:37:52.410316 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Name: Default May 23 12:37:52.410316 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Id: dcc45b8bab17498cadda8d64b3a76780 May 23 12:37:52.410316 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1322715344 May 23 12:37:52.410316 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Role: member,reader May 23 12:37:52.410316 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Roles: member,reader May 23 12:37:52.411855 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dcc45b8bab17498cadda8d64b3a76780"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dcc45b8bab17498cadda8d64b3a76780"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dcc45b8bab17498cadda8d64b3a76780", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dcc45b8bab17498cadda8d64b3a76780"}]}] May 23 12:37:52.411855 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1322715344 May 23 12:37:52.411855 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Id: dcc45b8bab17498cadda8d64b3a76780 May 23 12:37:52.411855 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1322715344 May 23 12:37:52.411855 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User: tempest-ServerRescueNegativeTestJSON-1322715344-project May 23 12:37:52.411855 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Id: default May 23 12:37:52.411855 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Name: Default May 23 12:37:52.411855 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Id: 687208d733174bffa2783e6857401f39 May 23 12:37:52.411855 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1322715344-project May 23 12:37:52.411855 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: method: > May 23 12:37:52.411855 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: exception: Cannot 'detach_volume' instance 64486ed1-2721-4c2a-a2fb-a96f3a82f32f while it is in vm_state rescued May 23 12:37:52.412714 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: action_args: {'server_id': '64486ed1-2721-4c2a-a2fb-a96f3a82f32f', 'id': '23e14746-9a92-488b-94ab-ebfe7513e9da'} May 23 12:37:52.412714 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:37:52.412714 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:37:52.412714 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 23 12:37:52.412714 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 23 12:37:52.412714 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 12:37:52.412714 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 12:37:52.412714 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 23 12:37:52.412714 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 23 12:37:52.412714 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 64486ed1-2721-4c2a-a2fb-a96f3a82f32f in vm_state rescued. Cannot detach_volume while the instance is in this state. May 23 12:37:52.412714 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:37:52.412714 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:37:52.412714 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:37:52.412714 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:37:52.412714 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:37:52.412714 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:37:52.412714 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:37:52.412714 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:37:52.412714 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:37:52.412714 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:37:52.414224 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 23 12:37:52.414224 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 23 12:37:52.414224 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 23 12:37:52.414224 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 23 12:37:52.414224 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 64486ed1-2721-4c2a-a2fb-a96f3a82f32f while it is in vm_state rescued May 23 12:37:52.414224 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:37:52.414224 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:37:52.414224 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:37:52.414224 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:37:52.414224 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:37:52.414224 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:37:52.414224 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:37:52.414224 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:37:52.414224 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 64486ed1-2721-4c2a-a2fb-a96f3a82f32f while it is in vm_state rescued May 23 12:37:52.414224 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:37:52.415353 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7af639f7-dc1f-44a3-bc31-43c78981202a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:52.415353 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7af639f7-dc1f-44a3-bc31-43c78981202a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:52.415555 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-e94834f1-a72a-4827-b488-4c020fc89afe tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Returning 409 to user: Cannot 'detach_volume' instance 64486ed1-2721-4c2a-a2fb-a96f3a82f32f while it is in vm_state rescued {{(pid=124200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:37:52.416559 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-e94834f1-a72a-4827-b488-4c020fc89afe tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "DELETE /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f/os-volume_attachments/23e14746-9a92-488b-94ab-ebfe7513e9da" status: 409 len: 152 microversion: 2.1 time: 0.104551 May 23 12:37:52.417546 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 271/541] 10.222.0.16 () {58 vars in 1415 bytes} [Mon May 23 12:37:52 2022] DELETE /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f/os-volume_attachments/23e14746-9a92-488b-94ab-ebfe7513e9da => generated 152 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 23 12:37:52.428104 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-9e9b1aab-4d70-49a5-9691-ae0ba796a1c7 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:37:52.428659 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-9e9b1aab-4d70-49a5-9691-ae0ba796a1c7 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:52.437252 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9e9b1aab-4d70-49a5-9691-ae0ba796a1c7 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:52.437685 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9e9b1aab-4d70-49a5-9691-ae0ba796a1c7 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:52.438474 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9e9b1aab-4d70-49a5-9691-ae0ba796a1c7 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:52.438913 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9e9b1aab-4d70-49a5-9691-ae0ba796a1c7 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:52.501691 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:52.513827 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-9e9b1aab-4d70-49a5-9691-ae0ba796a1c7 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "POST /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f/action" status: 202 len: 0 microversion: 2.1 time: 0.090384 May 23 12:37:52.517484 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 272/542] 10.222.0.16 () {60 vars in 1277 bytes} [Mon May 23 12:37:52 2022] POST /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 12:37:52.522945 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-f28f7399-e96d-4668-99da-d454933edf7a tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:52.523689 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-f28f7399-e96d-4668-99da-d454933edf7a tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:52.531138 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f28f7399-e96d-4668-99da-d454933edf7a tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:52.531594 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f28f7399-e96d-4668-99da-d454933edf7a tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:52.532408 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f28f7399-e96d-4668-99da-d454933edf7a tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:52.532880 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f28f7399-e96d-4668-99da-d454933edf7a tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:52.552356 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-7af639f7-dc1f-44a3-bc31-43c78981202a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:52.564622 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-7af639f7-dc1f-44a3-bc31-43c78981202a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:52.566452 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-7af639f7-dc1f-44a3-bc31-43c78981202a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:52.567561 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-7af639f7-dc1f-44a3-bc31-43c78981202a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1407 microversion: 2.20 time: 0.169539 May 23 12:37:52.568149 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 271/543] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:37:52 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:37:52.770137 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-f28f7399-e96d-4668-99da-d454933edf7a tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:52.779434 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-f28f7399-e96d-4668-99da-d454933edf7a tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f" status: 200 len: 1723 microversion: 2.1 time: 0.260453 May 23 12:37:52.780195 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 273/544] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:52 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f => generated 1723 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:37:53.587577 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c69b1f09-19a0-4eec-a085-4e0dcebcf233 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:53.588207 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c69b1f09-19a0-4eec-a085-4e0dcebcf233 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:53.594759 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c69b1f09-19a0-4eec-a085-4e0dcebcf233 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:53.595203 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c69b1f09-19a0-4eec-a085-4e0dcebcf233 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:53.595967 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c69b1f09-19a0-4eec-a085-4e0dcebcf233 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:53.596435 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c69b1f09-19a0-4eec-a085-4e0dcebcf233 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:53.726240 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c69b1f09-19a0-4eec-a085-4e0dcebcf233 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:53.734801 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c69b1f09-19a0-4eec-a085-4e0dcebcf233 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:53.736408 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c69b1f09-19a0-4eec-a085-4e0dcebcf233 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:53.737543 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c69b1f09-19a0-4eec-a085-4e0dcebcf233 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1407 microversion: 2.20 time: 0.154568 May 23 12:37:53.738094 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 272/545] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:37:53 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:37:53.806356 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-ab2bec59-b988-4044-a897-9f4b79418cab tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:53.807618 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-ab2bec59-b988-4044-a897-9f4b79418cab tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:53.814118 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ab2bec59-b988-4044-a897-9f4b79418cab tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:53.814525 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ab2bec59-b988-4044-a897-9f4b79418cab tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:53.815329 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ab2bec59-b988-4044-a897-9f4b79418cab tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:53.815783 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ab2bec59-b988-4044-a897-9f4b79418cab tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:53.950198 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-ab2bec59-b988-4044-a897-9f4b79418cab tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:53.958768 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-ab2bec59-b988-4044-a897-9f4b79418cab tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f" status: 200 len: 1723 microversion: 2.1 time: 0.156298 May 23 12:37:53.959447 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 274/546] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:53 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:37:54.755965 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-da420db7-ffdf-4bf5-8bd2-6c52c531068a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:54.756592 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-da420db7-ffdf-4bf5-8bd2-6c52c531068a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:54.758442 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell0:SELECT=6 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:54.764750 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-da420db7-ffdf-4bf5-8bd2-6c52c531068a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:54.765194 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-da420db7-ffdf-4bf5-8bd2-6c52c531068a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:54.765952 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-da420db7-ffdf-4bf5-8bd2-6c52c531068a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:54.766387 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-da420db7-ffdf-4bf5-8bd2-6c52c531068a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:54.895361 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-da420db7-ffdf-4bf5-8bd2-6c52c531068a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:54.905318 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-da420db7-ffdf-4bf5-8bd2-6c52c531068a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:54.906985 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-da420db7-ffdf-4bf5-8bd2-6c52c531068a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:54.908306 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-da420db7-ffdf-4bf5-8bd2-6c52c531068a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1599 microversion: 2.20 time: 0.156152 May 23 12:37:54.909099 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 273/547] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:37:54 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:37:54.926346 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-469763ac-c0a3-4bd6-9feb-52c299572746 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:54.926864 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-469763ac-c0a3-4bd6-9feb-52c299572746 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:54.928776 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell0:SELECT=2 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:54.929425 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell0:SELECT=6 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:54.935933 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-469763ac-c0a3-4bd6-9feb-52c299572746 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:54.936403 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-469763ac-c0a3-4bd6-9feb-52c299572746 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:54.937164 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-469763ac-c0a3-4bd6-9feb-52c299572746 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:54.937597 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-469763ac-c0a3-4bd6-9feb-52c299572746 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:54.976217 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-e23aa3b1-55b6-46e9-90cd-c725ec795de6 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:54.976826 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-e23aa3b1-55b6-46e9-90cd-c725ec795de6 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:54.983329 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e23aa3b1-55b6-46e9-90cd-c725ec795de6 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:54.983775 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e23aa3b1-55b6-46e9-90cd-c725ec795de6 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:54.984579 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e23aa3b1-55b6-46e9-90cd-c725ec795de6 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:54.985020 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e23aa3b1-55b6-46e9-90cd-c725ec795de6 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:55.014455 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-469763ac-c0a3-4bd6-9feb-52c299572746 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.092020 May 23 12:37:55.015044 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 275/548] 10.222.0.16 () {60 vars in 1315 bytes} [Mon May 23 12:37:54 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 12:37:55.117199 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-e23aa3b1-55b6-46e9-90cd-c725ec795de6 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:55.125453 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-e23aa3b1-55b6-46e9-90cd-c725ec795de6 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f" status: 200 len: 1723 microversion: 2.1 time: 0.152961 May 23 12:37:55.126119 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 274/549] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:54 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:37:56.144473 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-2fb86785-ad69-4d26-b19c-384b7648f542 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:56.146526 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-2fb86785-ad69-4d26-b19c-384b7648f542 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:56.154672 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2fb86785-ad69-4d26-b19c-384b7648f542 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:56.155388 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2fb86785-ad69-4d26-b19c-384b7648f542 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:56.156216 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2fb86785-ad69-4d26-b19c-384b7648f542 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:56.156673 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2fb86785-ad69-4d26-b19c-384b7648f542 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:56.158528 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-1a6391c8-1650-419a-88b6-c1dc0895b0bc req-d36e87cd-815b-4d86-a4d3-dde42e5897f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40320b2c-6137-4266-b3b6-fb76f3d6d654", "tag": "c581b4f8-de6e-4314-a04e-aca7063e49e5"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:37:56.169047 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-1a6391c8-1650-419a-88b6-c1dc0895b0bc req-d36e87cd-815b-4d86-a4d3-dde42e5897f4 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:56.169956 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-1a6391c8-1650-419a-88b6-c1dc0895b0bc req-d36e87cd-815b-4d86-a4d3-dde42e5897f4 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:56.181935 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-1a6391c8-1650-419a-88b6-c1dc0895b0bc req-d36e87cd-815b-4d86-a4d3-dde42e5897f4 service nova] Creating event network-changed:c581b4f8-de6e-4314-a04e-aca7063e49e5 for instance 40320b2c-6137-4266-b3b6-fb76f3d6d654 on hv-cinder-83699 May 23 12:37:56.187200 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-1a6391c8-1650-419a-88b6-c1dc0895b0bc req-d36e87cd-815b-4d86-a4d3-dde42e5897f4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032582 May 23 12:37:56.188226 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 275/550] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:37:56.300740 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-2fb86785-ad69-4d26-b19c-384b7648f542 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:56.309116 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-2fb86785-ad69-4d26-b19c-384b7648f542 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f" status: 200 len: 1729 microversion: 2.1 time: 0.169896 May 23 12:37:56.309699 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 276/551] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:56 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:37:56.326237 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b7f7ad72-09be-4fb4-8ca6-6c79032d7561 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:56.326851 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-b7f7ad72-09be-4fb4-8ca6-6c79032d7561 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:56.333246 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b7f7ad72-09be-4fb4-8ca6-6c79032d7561 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:56.333698 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b7f7ad72-09be-4fb4-8ca6-6c79032d7561 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:56.334469 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b7f7ad72-09be-4fb4-8ca6-6c79032d7561 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:56.334910 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b7f7ad72-09be-4fb4-8ca6-6c79032d7561 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:56.414946 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b7f7ad72-09be-4fb4-8ca6-6c79032d7561 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093306 May 23 12:37:56.415545 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 276/552] 10.222.0.16 () {58 vars in 1274 bytes} [Mon May 23 12:37:56 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:37:57.993344 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-35585b67-5f79-472e-98ab-2cf64a4ca9fa req-6c265da0-0c46-4937-b475-212f13dfcdb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64486ed1-2721-4c2a-a2fb-a96f3a82f32f", "tag": "ccd5bdc8-a41b-4e8c-aebe-0858a605b65b"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:37:58.002459 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-35585b67-5f79-472e-98ab-2cf64a4ca9fa req-6c265da0-0c46-4937-b475-212f13dfcdb6 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:58.002903 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-35585b67-5f79-472e-98ab-2cf64a4ca9fa req-6c265da0-0c46-4937-b475-212f13dfcdb6 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:58.019518 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-35585b67-5f79-472e-98ab-2cf64a4ca9fa req-6c265da0-0c46-4937-b475-212f13dfcdb6 service nova] Creating event network-changed:ccd5bdc8-a41b-4e8c-aebe-0858a605b65b for instance 64486ed1-2721-4c2a-a2fb-a96f3a82f32f on hv-cinder-83699 May 23 12:37:58.029602 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-35585b67-5f79-472e-98ab-2cf64a4ca9fa req-6c265da0-0c46-4937-b475-212f13dfcdb6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039494 May 23 12:37:58.031663 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 277/553] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:37:59.100069 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-3840d0d9-b8de-4ff3-a822-03e5524cdbac tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:59.101018 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-3840d0d9-b8de-4ff3-a822-03e5524cdbac tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:59.107697 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3840d0d9-b8de-4ff3-a822-03e5524cdbac tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:59.108151 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3840d0d9-b8de-4ff3-a822-03e5524cdbac tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:59.108953 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3840d0d9-b8de-4ff3-a822-03e5524cdbac tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:59.109413 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3840d0d9-b8de-4ff3-a822-03e5524cdbac tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:59.137651 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-3840d0d9-b8de-4ff3-a822-03e5524cdbac tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042081 May 23 12:37:59.138202 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 277/554] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 12:37:59 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 12:37:59.197180 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-3cb5a4a8-684b-4d4f-84f2-0611bc69fc22 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:59.197859 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-3cb5a4a8-684b-4d4f-84f2-0611bc69fc22 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:59.204555 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3cb5a4a8-684b-4d4f-84f2-0611bc69fc22 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:59.205010 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3cb5a4a8-684b-4d4f-84f2-0611bc69fc22 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:59.205768 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3cb5a4a8-684b-4d4f-84f2-0611bc69fc22 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:59.206231 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3cb5a4a8-684b-4d4f-84f2-0611bc69fc22 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:59.232233 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-3cb5a4a8-684b-4d4f-84f2-0611bc69fc22 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Going to try to terminate instance {{(pid=124200) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 12:37:59.305886 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-3cb5a4a8-684b-4d4f-84f2-0611bc69fc22 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "DELETE /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 204 len: 0 microversion: 2.1 time: 0.112943 May 23 12:37:59.306435 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 278/555] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 12:37:59 2022] DELETE /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 12:37:59.314709 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-445dde35-2e2f-414e-a532-017e5e6fc954 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:37:59.315310 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-445dde35-2e2f-414e-a532-017e5e6fc954 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:37:59.321300 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-445dde35-2e2f-414e-a532-017e5e6fc954 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:59.321742 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-445dde35-2e2f-414e-a532-017e5e6fc954 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:59.323353 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-445dde35-2e2f-414e-a532-017e5e6fc954 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:37:59.323802 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-445dde35-2e2f-414e-a532-017e5e6fc954 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:37:59.460482 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-445dde35-2e2f-414e-a532-017e5e6fc954 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:37:59.469111 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-445dde35-2e2f-414e-a532-017e5e6fc954 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 200 len: 1672 microversion: 2.1 time: 0.158288 May 23 12:37:59.469690 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 278/556] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:37:59 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:38:00.047356 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-1d10f396-f99f-4c11-b38b-5f282c91d5ce req-010b7c9d-b56b-4056-9fff-984e09ebad57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64486ed1-2721-4c2a-a2fb-a96f3a82f32f", "tag": "ccd5bdc8-a41b-4e8c-aebe-0858a605b65b"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:38:00.058209 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-1d10f396-f99f-4c11-b38b-5f282c91d5ce req-010b7c9d-b56b-4056-9fff-984e09ebad57 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:00.058924 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-1d10f396-f99f-4c11-b38b-5f282c91d5ce req-010b7c9d-b56b-4056-9fff-984e09ebad57 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:00.070986 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-1d10f396-f99f-4c11-b38b-5f282c91d5ce req-010b7c9d-b56b-4056-9fff-984e09ebad57 service nova] Creating event network-changed:ccd5bdc8-a41b-4e8c-aebe-0858a605b65b for instance 64486ed1-2721-4c2a-a2fb-a96f3a82f32f on hv-cinder-83699 May 23 12:38:00.076080 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-1d10f396-f99f-4c11-b38b-5f282c91d5ce req-010b7c9d-b56b-4056-9fff-984e09ebad57 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033002 May 23 12:38:00.076825 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 279/557] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:38:00.445129 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b459d0d3-dff7-427c-a4ac-48f3b4b57ab3 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:00.445661 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-b459d0d3-dff7-427c-a4ac-48f3b4b57ab3 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: f2e15c2c-04cc-435b-a633-39c4ae1a5e24] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:00.452083 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b459d0d3-dff7-427c-a4ac-48f3b4b57ab3 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:00.452861 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b459d0d3-dff7-427c-a4ac-48f3b4b57ab3 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:00.453668 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b459d0d3-dff7-427c-a4ac-48f3b4b57ab3 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:00.454124 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b459d0d3-dff7-427c-a4ac-48f3b4b57ab3 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:00.477494 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b459d0d3-dff7-427c-a4ac-48f3b4b57ab3 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24/ips" status: 200 len: 149 microversion: 2.1 time: 0.036365 May 23 12:38:00.478048 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 279/558] 10.222.0.16 () {58 vars in 1247 bytes} [Mon May 23 12:38:00 2022] GET /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:38:00.487554 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-16058d01-08b1-4fac-bc56-e806627aef0a tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:00.488282 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-16058d01-08b1-4fac-bc56-e806627aef0a tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:00.494959 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-16058d01-08b1-4fac-bc56-e806627aef0a tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:00.495416 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-16058d01-08b1-4fac-bc56-e806627aef0a tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:00.496204 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-16058d01-08b1-4fac-bc56-e806627aef0a tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:00.496644 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-16058d01-08b1-4fac-bc56-e806627aef0a tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:00.631302 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-16058d01-08b1-4fac-bc56-e806627aef0a tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:00.641348 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-16058d01-08b1-4fac-bc56-e806627aef0a tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 200 len: 1672 microversion: 2.1 time: 0.158211 May 23 12:38:00.642349 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 280/559] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:38:00 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:38:01.660444 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f611726f-884b-4fa7-8871-2fd73562b307 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:01.661065 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-f611726f-884b-4fa7-8871-2fd73562b307 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:01.663506 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:38:01.669543 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f611726f-884b-4fa7-8871-2fd73562b307 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:01.670145 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f611726f-884b-4fa7-8871-2fd73562b307 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:01.670781 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f611726f-884b-4fa7-8871-2fd73562b307 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:01.671226 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f611726f-884b-4fa7-8871-2fd73562b307 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:01.805772 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-1633edef-2df1-40ec-b841-85c3f9acdae4 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7c3fd6d-58b0-4cb3-a2b3-22ac5872a1e0"}} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:38:01.807550 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-1633edef-2df1-40ec-b841-85c3f9acdae4 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: f2e15c2c-04cc-435b-a633-39c4ae1a5e24] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:01.809648 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f611726f-884b-4fa7-8871-2fd73562b307 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:01.814033 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1633edef-2df1-40ec-b841-85c3f9acdae4 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:01.814490 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1633edef-2df1-40ec-b841-85c3f9acdae4 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:01.815279 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1633edef-2df1-40ec-b841-85c3f9acdae4 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:01.815724 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1633edef-2df1-40ec-b841-85c3f9acdae4 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:01.819193 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f611726f-884b-4fa7-8871-2fd73562b307 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 200 len: 1672 microversion: 2.1 time: 0.162478 May 23 12:38:01.819925 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 280/560] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:38:01 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 1672 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:38:02.070129 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-1633edef-2df1-40ec-b841-85c3f9acdae4 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "POST /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268053 May 23 12:38:02.070926 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 281/561] 10.222.0.16 () {60 vars in 1322 bytes} [Mon May 23 12:38:01 2022] POST /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:38:02.379379 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-3da085bd-618b-4c89-bc4d-ce3af8e7656a req-a302a87d-d20e-4927-876c-259123e40205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "380a99e6-38d9-4af6-9fa8-5506a0ffcf5e", "name": "network-vif-deleted", "tag": "1c168015-cbd1-4ffe-8cf8-c803d21df858"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:38:02.388444 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-3da085bd-618b-4c89-bc4d-ce3af8e7656a req-a302a87d-d20e-4927-876c-259123e40205 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:02.388897 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-3da085bd-618b-4c89-bc4d-ce3af8e7656a req-a302a87d-d20e-4927-876c-259123e40205 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:02.401977 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-3da085bd-618b-4c89-bc4d-ce3af8e7656a req-a302a87d-d20e-4927-876c-259123e40205 service nova] Creating event network-vif-deleted:1c168015-cbd1-4ffe-8cf8-c803d21df858 for instance 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e on hv-cinder-83699 May 23 12:38:02.407012 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-3da085bd-618b-4c89-bc4d-ce3af8e7656a req-a302a87d-d20e-4927-876c-259123e40205 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031306 May 23 12:38:02.411651 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 281/562] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:38:02.837902 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-eb4c4d2e-01e1-4fbc-bee3-3142d8dc7b18 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:02.838672 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-eb4c4d2e-01e1-4fbc-bee3-3142d8dc7b18 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:02.845014 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-eb4c4d2e-01e1-4fbc-bee3-3142d8dc7b18 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:02.845464 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-eb4c4d2e-01e1-4fbc-bee3-3142d8dc7b18 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:02.846278 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-eb4c4d2e-01e1-4fbc-bee3-3142d8dc7b18 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:02.846718 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-eb4c4d2e-01e1-4fbc-bee3-3142d8dc7b18 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:02.879441 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-eb4c4d2e-01e1-4fbc-bee3-3142d8dc7b18 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:02.879888 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-eb4c4d2e-01e1-4fbc-bee3-3142d8dc7b18 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:02.880402 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.objects.instance [None req-eb4c4d2e-01e1-4fbc-bee3-3142d8dc7b18 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lazy-loading 'fault' on Instance uuid 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e {{(pid=124200) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:38:02.926799 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-eb4c4d2e-01e1-4fbc-bee3-3142d8dc7b18 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:02.935048 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-eb4c4d2e-01e1-4fbc-bee3-3142d8dc7b18 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 200 len: 1328 microversion: 2.1 time: 0.101892 May 23 12:38:02.935612 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 282/563] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:38:02 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 1328 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:38:03.953140 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-1d1583db-914a-4dbb-8a8b-0b928d3f8fac tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:03.953914 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-1d1583db-914a-4dbb-8a8b-0b928d3f8fac tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:03.960689 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1d1583db-914a-4dbb-8a8b-0b928d3f8fac tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:03.961134 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1d1583db-914a-4dbb-8a8b-0b928d3f8fac tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:03.961893 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1d1583db-914a-4dbb-8a8b-0b928d3f8fac tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:03.962331 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1d1583db-914a-4dbb-8a8b-0b928d3f8fac tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:03.975525 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.wsgi [None req-1d1583db-914a-4dbb-8a8b-0b928d3f8fac tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] HTTP exception thrown: Instance 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e could not be found. May 23 12:38:03.977171 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-1d1583db-914a-4dbb-8a8b-0b928d3f8fac tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Request method failure captured: May 23 12:38:03.977171 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: request: GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e HTTP/1.1 May 23 12:38:03.977171 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept: application/json May 23 12:38:03.977171 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept-Encoding: identity May 23 12:38:03.977171 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Connection: close May 23 12:38:03.977171 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Length: 0 May 23 12:38:03.977171 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Type: application/json May 23 12:38:03.977171 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Host: 10.222.0.16 May 23 12:38:03.977171 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Openstack-System-Scope: None May 23 12:38:03.977171 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: User-Agent: python-urllib3/1.26.9 May 23 12:38:03.977171 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Auth-Token: gAAAAABii38aXdKGMOEVZ2spEcutkaQ86Yc_NLCUbMHOXXQH8Bm8w2vzfmASCK0LDJk-Hh7hHX90aFsUsBLdB-dTHGD9i7_ibWA6MXmnHMUtHbJnyrAFrC09GqDvy-mdyJpa7IcS6ayZUQlOhJ_hIkrPICcxCi1iE5fq6VI-EmRi6tTe7pQxsRo May 23 12:38:03.977171 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Id: None May 23 12:38:03.977171 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Name: None May 23 12:38:03.977171 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Identity-Status: Confirmed May 23 12:38:03.977171 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Is-Admin-Project: True May 23 12:38:03.977171 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Id: default May 23 12:38:03.977171 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Name: Default May 23 12:38:03.977171 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Id: 736376830ed340b2aa62c455c134c4e2 May 23 12:38:03.977171 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Name: tempest-AttachVolumeTestJSON-2113320926 May 23 12:38:03.977171 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Role: member,reader May 23 12:38:03.977171 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Roles: member,reader May 23 12:38:03.979370 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/736376830ed340b2aa62c455c134c4e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/736376830ed340b2aa62c455c134c4e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_736376830ed340b2aa62c455c134c4e2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/736376830ed340b2aa62c455c134c4e2"}]}] May 23 12:38:03.979370 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant: tempest-AttachVolumeTestJSON-2113320926 May 23 12:38:03.979370 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Id: 736376830ed340b2aa62c455c134c4e2 May 23 12:38:03.979370 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2113320926 May 23 12:38:03.979370 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User: tempest-AttachVolumeTestJSON-2113320926-project May 23 12:38:03.979370 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Id: default May 23 12:38:03.979370 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Name: Default May 23 12:38:03.979370 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Id: 771d3e22beff44f7bbc3103fd75a35b4 May 23 12:38:03.979370 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Name: tempest-AttachVolumeTestJSON-2113320926-project May 23 12:38:03.979370 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: method: > May 23 12:38:03.979370 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: exception: Instance 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e could not be found. May 23 12:38:03.979370 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: action_args: {'id': '380a99e6-38d9-4af6-9fa8-5506a0ffcf5e'} May 23 12:38:03.980417 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:38:03.980417 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:38:03.980417 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:38:03.980417 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:38:03.980417 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:38:03.980417 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:38:03.980417 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:38:03.980417 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:38:03.980417 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:38:03.980417 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:38:03.980417 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e could not be found. May 23 12:38:03.980417 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:38:03.980417 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:38:03.980417 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:38:03.980417 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:38:03.980417 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:38:03.980417 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:38:03.980417 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:38:03.980417 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:38:03.980417 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:38:03.981884 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:38:03.981884 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:38:03.981884 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:38:03.981884 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:38:03.981884 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:38:03.981884 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:38:03.981884 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:38:03.981884 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e could not be found. May 23 12:38:03.981884 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:38:03.981884 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:38:03.981884 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:38:03.981884 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:38:03.981884 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:38:03.981884 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:38:03.981884 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:38:03.981884 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:38:03.981884 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e could not be found. May 23 12:38:03.981884 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:38:03.983273 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-1d1583db-914a-4dbb-8a8b-0b928d3f8fac tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Returning 404 to user: Instance 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e could not be found. {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:38:03.983273 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-1d1583db-914a-4dbb-8a8b-0b928d3f8fac tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 404 len: 111 microversion: 2.1 time: 0.030539 May 23 12:38:03.983273 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 282/564] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:38:03 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:38:03.988673 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-280e9233-b1d2-4954-a9b4-2fbfd31bd2a7 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '.version_select at 0x7f095cbcd940>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:04.008554 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-280e9233-b1d2-4954-a9b4-2fbfd31bd2a7 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2146788300" status: 202 len: 0 microversion: 2.1 time: 0.023960 May 23 12:38:04.009187 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 283/565] 10.222.0.16 () {58 vars in 1220 bytes} [Mon May 23 12:38:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2146788300 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:38:04.631427 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-eb960865-7341-4316-b31c-84f9bf10d1b7 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Action: 'create', calling method: .version_select at 0x7f095d1e3af0>, body: {"keypair": {"name": "tempest-keypair-1672508328", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpLxSmerGXqjgxpe9ptaPxgh/DIjpIoUgBL7J9XyKfO+BcmPRdTul5TZtEpP8vHOD1SBpww+xsKUCTvD9f3ztBuucihTP2UGdF9D2//MI4uohEUiey0NMPYH+cM42QI2g=="}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:38:04.649092 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-eb960865-7341-4316-b31c-84f9bf10d1b7 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Getting quotas for project 736376830ed340b2aa62c455c134c4e2. Resources: {'key_pairs'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:38:04.655463 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-eb960865-7341-4316-b31c-84f9bf10d1b7 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Getting quotas for user 771d3e22beff44f7bbc3103fd75a35b4 and project 736376830ed340b2aa62c455c134c4e2. Resources: {'key_pairs'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:38:04.676977 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-eb960865-7341-4316-b31c-84f9bf10d1b7 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049497 May 23 12:38:04.677572 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 283/566] 10.222.0.16 () {60 vars in 1158 bytes} [Mon May 23 12:38:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:38:05.992575 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-303ca074-3771-4e0e-b7c8-50627b199036 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-693672120", "imageRef": "bb11dfa4-2977-4163-8237-78c871c8437f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cc274260-5d38-4e43-aa07-b73fcfa156ea"}], "security_groups": [{"name": "tempest-securitygroup--143547847"}], "key_name": "tempest-keypair-1672508328", "user_data": "}} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:38:06.095557 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.network.neutron [None req-303ca074-3771-4e0e-b7c8-50627b199036 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] validate_networks() for [('cc274260-5d38-4e43-aa07-b73fcfa156ea', None, None, None, None, None)] {{(pid=124200) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 12:38:06.475385 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-303ca074-3771-4e0e-b7c8-50627b199036 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Flavor limits 0:0:0 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 12:38:06.475803 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-303ca074-3771-4e0e-b7c8-50627b199036 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Image limits 0:0:0 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 12:38:06.476313 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-303ca074-3771-4e0e-b7c8-50627b199036 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Flavor pref 0:0:0 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 12:38:06.476719 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-303ca074-3771-4e0e-b7c8-50627b199036 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Image pref 0:0:0 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 12:38:06.477161 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-303ca074-3771-4e0e-b7c8-50627b199036 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 12:38:06.486709 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-303ca074-3771-4e0e-b7c8-50627b199036 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:06.487091 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-303ca074-3771-4e0e-b7c8-50627b199036 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:06.487881 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-303ca074-3771-4e0e-b7c8-50627b199036 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:06.488354 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-303ca074-3771-4e0e-b7c8-50627b199036 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:06.508917 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.quota [None req-303ca074-3771-4e0e-b7c8-50627b199036 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Getting quotas for project 736376830ed340b2aa62c455c134c4e2. Resources: {'instances', 'cores', 'ram'} {{(pid=124200) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:38:06.513075 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.quota [None req-303ca074-3771-4e0e-b7c8-50627b199036 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Getting quotas for user 771d3e22beff44f7bbc3103fd75a35b4 and project 736376830ed340b2aa62c455c134c4e2. Resources: {'instances', 'cores', 'ram'} {{(pid=124200) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:38:06.528296 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-303ca074-3771-4e0e-b7c8-50627b199036 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Going to run 1 instances... {{(pid=124200) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 12:38:06.530596 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-303ca074-3771-4e0e-b7c8-50627b199036 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 9a267457-7f06-4312-87ce-2c47cdb2924d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb11dfa4-2977-4163-8237-78c871c8437f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124200) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 12:38:06.577800 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-303ca074-3771-4e0e-b7c8-50627b199036 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.590431 May 23 12:38:06.583431 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 284/567] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 23 12:38:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 12:38:06.591448 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-65654fac-39e1-4b88-8336-35e1254ac073 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:06.592140 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-65654fac-39e1-4b88-8336-35e1254ac073 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 9a267457-7f06-4312-87ce-2c47cdb2924d] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:06.657757 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-65654fac-39e1-4b88-8336-35e1254ac073 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:06.666359 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-65654fac-39e1-4b88-8336-35e1254ac073 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d" status: 200 len: 1237 microversion: 2.1 time: 0.080981 May 23 12:38:06.667161 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 284/568] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:38:06 2022] GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d => generated 1237 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:38:07.684718 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-b17d0f78-d730-47c6-a1fe-ee6c05b4597f tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:07.685985 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-b17d0f78-d730-47c6-a1fe-ee6c05b4597f tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 9a267457-7f06-4312-87ce-2c47cdb2924d] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:07.693662 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b17d0f78-d730-47c6-a1fe-ee6c05b4597f tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:07.694374 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b17d0f78-d730-47c6-a1fe-ee6c05b4597f tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:07.695327 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b17d0f78-d730-47c6-a1fe-ee6c05b4597f tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:07.695930 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b17d0f78-d730-47c6-a1fe-ee6c05b4597f tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:07.762856 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-b17d0f78-d730-47c6-a1fe-ee6c05b4597f tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:07.770446 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-b17d0f78-d730-47c6-a1fe-ee6c05b4597f tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d" status: 200 len: 1307 microversion: 2.1 time: 0.091279 May 23 12:38:07.771000 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 285/569] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:38:07 2022] GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d => generated 1307 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:38:08.788566 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-3a9faedf-5c0b-4769-9e0a-67658b078dcc tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:08.789784 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-3a9faedf-5c0b-4769-9e0a-67658b078dcc tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 9a267457-7f06-4312-87ce-2c47cdb2924d] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:08.798023 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3a9faedf-5c0b-4769-9e0a-67658b078dcc tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:08.799289 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3a9faedf-5c0b-4769-9e0a-67658b078dcc tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:08.800399 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3a9faedf-5c0b-4769-9e0a-67658b078dcc tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:08.800983 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3a9faedf-5c0b-4769-9e0a-67658b078dcc tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:09.027817 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-3a9faedf-5c0b-4769-9e0a-67658b078dcc tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:09.035424 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-3a9faedf-5c0b-4769-9e0a-67658b078dcc tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d" status: 200 len: 1362 microversion: 2.1 time: 0.251017 May 23 12:38:09.035992 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 285/570] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:38:08 2022] GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d => generated 1362 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:38:09.466204 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-7d7fd02a-e990-469f-b14f-2f5e10c67467 req-3868edc1-bf76-407b-9568-7fc6552273ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a267457-7f06-4312-87ce-2c47cdb2924d", "tag": "b8447d6b-c07d-4b91-8b57-270b92719707"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:38:09.471385 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=2,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:38:09.498146 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-7d7fd02a-e990-469f-b14f-2f5e10c67467 req-3868edc1-bf76-407b-9568-7fc6552273ff service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:09.498597 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-7d7fd02a-e990-469f-b14f-2f5e10c67467 req-3868edc1-bf76-407b-9568-7fc6552273ff service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:09.515571 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-7d7fd02a-e990-469f-b14f-2f5e10c67467 req-3868edc1-bf76-407b-9568-7fc6552273ff service nova] Creating event network-changed:b8447d6b-c07d-4b91-8b57-270b92719707 for instance 9a267457-7f06-4312-87ce-2c47cdb2924d on hv-cinder-83699 May 23 12:38:09.520931 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-7d7fd02a-e990-469f-b14f-2f5e10c67467 req-3868edc1-bf76-407b-9568-7fc6552273ff service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059169 May 23 12:38:09.521954 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 286/571] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:38:09.613905 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-bac26804-7428-4f44-a5a8-6c78ff6caa73 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7c3fd6d-58b0-4cb3-a2b3-22ac5872a1e0"}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:38:09.614995 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-bac26804-7428-4f44-a5a8-6c78ff6caa73 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: f2e15c2c-04cc-435b-a633-39c4ae1a5e24] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:09.622426 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bac26804-7428-4f44-a5a8-6c78ff6caa73 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:09.622889 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bac26804-7428-4f44-a5a8-6c78ff6caa73 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:09.623691 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bac26804-7428-4f44-a5a8-6c78ff6caa73 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:09.624134 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bac26804-7428-4f44-a5a8-6c78ff6caa73 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:09.715841 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.wsgi [None req-bac26804-7428-4f44-a5a8-6c78ff6caa73 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] HTTP exception thrown: Invalid volume: volume e7c3fd6d-58b0-4cb3-a2b3-22ac5872a1e0 is already attached to instances: f2e15c2c-04cc-435b-a633-39c4ae1a5e24 May 23 12:38:09.717853 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-bac26804-7428-4f44-a5a8-6c78ff6caa73 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Request method failure captured: May 23 12:38:09.717853 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: request: POST /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24/os-volume_attachments HTTP/1.1 May 23 12:38:09.717853 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept: application/json May 23 12:38:09.717853 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept-Encoding: identity May 23 12:38:09.717853 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Connection: close May 23 12:38:09.717853 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Length: 74 May 23 12:38:09.717853 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Type: application/json May 23 12:38:09.717853 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Host: 10.222.0.16 May 23 12:38:09.717853 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Openstack-System-Scope: None May 23 12:38:09.717853 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: User-Agent: python-urllib3/1.26.9 May 23 12:38:09.717853 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Auth-Token: gAAAAABii38ZU7Vwsw5AAU8G7deCk06Tjsg_k90-PVfeWrd3aNHg-oGVBFwUfnF7AZgHGAQrHmO4XQOE1Bz6uWE6i2CAUoXJsEuLNZGXvkqTPiv0H7N4ZSkFEsbSkgm2LM1J6iSbSGefN_01pdctKfH8BgGpUswrmPhK0nZLP7jsVPYKp_z7ea8 May 23 12:38:09.717853 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Id: None May 23 12:38:09.717853 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Name: None May 23 12:38:09.717853 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Identity-Status: Confirmed May 23 12:38:09.717853 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Is-Admin-Project: True May 23 12:38:09.717853 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Id: default May 23 12:38:09.717853 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Name: Default May 23 12:38:09.717853 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Id: da82f9c566664cb1a974cf0d1bf1b09d May 23 12:38:09.717853 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Name: tempest-AttachVolumeNegativeTest-2053273606 May 23 12:38:09.717853 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Role: member,reader May 23 12:38:09.717853 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Roles: member,reader May 23 12:38:09.719418 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da82f9c566664cb1a974cf0d1bf1b09d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da82f9c566664cb1a974cf0d1bf1b09d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da82f9c566664cb1a974cf0d1bf1b09d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da82f9c566664cb1a974cf0d1bf1b09d"}]}] May 23 12:38:09.719418 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant: tempest-AttachVolumeNegativeTest-2053273606 May 23 12:38:09.719418 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Id: da82f9c566664cb1a974cf0d1bf1b09d May 23 12:38:09.719418 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2053273606 May 23 12:38:09.719418 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User: tempest-AttachVolumeNegativeTest-2053273606-project May 23 12:38:09.719418 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Id: default May 23 12:38:09.719418 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Name: Default May 23 12:38:09.719418 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Id: ef222fe025534a9e942f8c5c4ed1e3e7 May 23 12:38:09.719418 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Name: tempest-AttachVolumeNegativeTest-2053273606-project May 23 12:38:09.719418 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: May 23 12:38:09.719418 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: {"volumeAttachment": {"volumeId": "e7c3fd6d-58b0-4cb3-a2b3-22ac5872a1e0"}} May 23 12:38:09.719418 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: method: > May 23 12:38:09.720317 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: exception: Invalid volume: volume e7c3fd6d-58b0-4cb3-a2b3-22ac5872a1e0 is already attached to instances: f2e15c2c-04cc-435b-a633-39c4ae1a5e24 May 23 12:38:09.720317 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: action_args: {'server_id': 'f2e15c2c-04cc-435b-a633-39c4ae1a5e24', 'body': {'volumeAttachment': {'volumeId': 'e7c3fd6d-58b0-4cb3-a2b3-22ac5872a1e0'}}} May 23 12:38:09.720317 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:38:09.720317 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:38:09.720317 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 23 12:38:09.720317 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 23 12:38:09.720317 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 12:38:09.720317 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 12:38:09.720317 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 23 12:38:09.720317 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 23 12:38:09.720317 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 23 12:38:09.720317 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 23 12:38:09.720317 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 23 12:38:09.720317 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 23 12:38:09.720317 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e7c3fd6d-58b0-4cb3-a2b3-22ac5872a1e0 is already attached to instances: f2e15c2c-04cc-435b-a633-39c4ae1a5e24 May 23 12:38:09.720317 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:38:09.720317 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:38:09.720317 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:38:09.720317 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:38:09.721685 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:38:09.721685 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:38:09.721685 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:38:09.721685 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:38:09.721685 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:38:09.721685 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:38:09.721685 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 12:38:09.721685 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 12:38:09.721685 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 12:38:09.721685 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 12:38:09.721685 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 12:38:09.721685 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 12:38:09.721685 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 23 12:38:09.721685 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 23 12:38:09.721685 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e7c3fd6d-58b0-4cb3-a2b3-22ac5872a1e0 is already attached to instances: f2e15c2c-04cc-435b-a633-39c4ae1a5e24 May 23 12:38:09.721685 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:38:09.721685 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:38:09.721685 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:38:09.721685 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:38:09.721685 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:38:09.723172 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:38:09.723172 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:38:09.723172 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:38:09.723172 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e7c3fd6d-58b0-4cb3-a2b3-22ac5872a1e0 is already attached to instances: f2e15c2c-04cc-435b-a633-39c4ae1a5e24 May 23 12:38:09.723172 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:38:09.724372 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-bac26804-7428-4f44-a5a8-6c78ff6caa73 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Returning 400 to user: Invalid volume: volume e7c3fd6d-58b0-4cb3-a2b3-22ac5872a1e0 is already attached to instances: f2e15c2c-04cc-435b-a633-39c4ae1a5e24 {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:38:09.725245 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-bac26804-7428-4f44-a5a8-6c78ff6caa73 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "POST /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.115639 May 23 12:38:09.725832 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 286/572] 10.222.0.16 () {60 vars in 1322 bytes} [Mon May 23 12:38:09 2022] POST /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24/os-volume_attachments => generated 174 bytes in 117 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 23 12:38:09.795840 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-756bb50a-412f-467a-8124-e8ae660516e2 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:09.796591 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-756bb50a-412f-467a-8124-e8ae660516e2 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: f2e15c2c-04cc-435b-a633-39c4ae1a5e24] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:09.804150 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-756bb50a-412f-467a-8124-e8ae660516e2 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:09.804663 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-756bb50a-412f-467a-8124-e8ae660516e2 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:09.805481 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-756bb50a-412f-467a-8124-e8ae660516e2 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:09.805912 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-756bb50a-412f-467a-8124-e8ae660516e2 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:10.003141 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.objects.instance [None req-756bb50a-412f-467a-8124-e8ae660516e2 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lazy-loading 'services' on Instance uuid f2e15c2c-04cc-435b-a633-39c4ae1a5e24 {{(pid=124200) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:38:10.053673 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-93de61e1-a5f9-4243-9d0c-7c23f8ddb8df tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:10.054389 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-93de61e1-a5f9-4243-9d0c-7c23f8ddb8df tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 9a267457-7f06-4312-87ce-2c47cdb2924d] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:10.064357 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-93de61e1-a5f9-4243-9d0c-7c23f8ddb8df tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:10.065343 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-93de61e1-a5f9-4243-9d0c-7c23f8ddb8df tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:10.066459 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-93de61e1-a5f9-4243-9d0c-7c23f8ddb8df tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:10.066899 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-93de61e1-a5f9-4243-9d0c-7c23f8ddb8df tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:10.085227 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-756bb50a-412f-467a-8124-e8ae660516e2 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24/os-volume_attachments/e7c3fd6d-58b0-4cb3-a2b3-22ac5872a1e0" status: 202 len: 0 microversion: 2.1 time: 0.295137 May 23 12:38:10.086478 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 287/573] 10.222.0.16 () {58 vars in 1415 bytes} [Mon May 23 12:38:09 2022] DELETE /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24/os-volume_attachments/e7c3fd6d-58b0-4cb3-a2b3-22ac5872a1e0 => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:38:10.096294 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-d0be1620-f311-4ace-a698-9650c1284d53 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:10.097309 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-d0be1620-f311-4ace-a698-9650c1284d53 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: f2e15c2c-04cc-435b-a633-39c4ae1a5e24] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:10.106978 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d0be1620-f311-4ace-a698-9650c1284d53 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:10.107883 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d0be1620-f311-4ace-a698-9650c1284d53 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:10.108870 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d0be1620-f311-4ace-a698-9650c1284d53 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:10.109409 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d0be1620-f311-4ace-a698-9650c1284d53 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:10.145021 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-d0be1620-f311-4ace-a698-9650c1284d53 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053988 May 23 12:38:10.145723 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 288/574] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 12:38:10 2022] GET /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:38:10.215996 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-93de61e1-a5f9-4243-9d0c-7c23f8ddb8df tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:10.223605 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-93de61e1-a5f9-4243-9d0c-7c23f8ddb8df tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d" status: 200 len: 1362 microversion: 2.1 time: 0.173945 May 23 12:38:10.224180 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 287/575] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:38:10 2022] GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:38:10.279212 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 12:38:10.279411 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Mon May 23 12:38:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 12:38:11.157734 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-a872db3a-bf11-473c-8b9f-7cad0e53e12b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:11.158655 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-a872db3a-bf11-473c-8b9f-7cad0e53e12b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: f2e15c2c-04cc-435b-a633-39c4ae1a5e24] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:11.164825 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a872db3a-bf11-473c-8b9f-7cad0e53e12b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:11.165286 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a872db3a-bf11-473c-8b9f-7cad0e53e12b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:11.166640 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a872db3a-bf11-473c-8b9f-7cad0e53e12b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:11.167109 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a872db3a-bf11-473c-8b9f-7cad0e53e12b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:11.181058 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=93,nova_cell1:UPDATE=3 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:38:11.198923 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-a872db3a-bf11-473c-8b9f-7cad0e53e12b tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045243 May 23 12:38:11.199494 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 289/576] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 12:38:11 2022] GET /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:38:11.241081 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-2d18ed3f-8ee2-4894-98a9-a7989c3b8d00 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:11.241689 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-2d18ed3f-8ee2-4894-98a9-a7989c3b8d00 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 9a267457-7f06-4312-87ce-2c47cdb2924d] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:11.249339 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2d18ed3f-8ee2-4894-98a9-a7989c3b8d00 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:11.249781 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2d18ed3f-8ee2-4894-98a9-a7989c3b8d00 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:11.250591 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2d18ed3f-8ee2-4894-98a9-a7989c3b8d00 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:11.251140 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2d18ed3f-8ee2-4894-98a9-a7989c3b8d00 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:11.393097 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-2d18ed3f-8ee2-4894-98a9-a7989c3b8d00 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:11.401388 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-2d18ed3f-8ee2-4894-98a9-a7989c3b8d00 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d" status: 200 len: 1362 microversion: 2.1 time: 0.164021 May 23 12:38:11.401940 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 288/577] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:38:11 2022] GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:38:12.211236 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-c2fad20c-bf17-4eed-9e37-67a96f901efd tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:12.212353 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-c2fad20c-bf17-4eed-9e37-67a96f901efd tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: f2e15c2c-04cc-435b-a633-39c4ae1a5e24] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:12.219190 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c2fad20c-bf17-4eed-9e37-67a96f901efd tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:12.219785 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c2fad20c-bf17-4eed-9e37-67a96f901efd tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:12.220671 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c2fad20c-bf17-4eed-9e37-67a96f901efd tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:12.221185 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c2fad20c-bf17-4eed-9e37-67a96f901efd tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:12.252446 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-c2fad20c-bf17-4eed-9e37-67a96f901efd tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045119 May 23 12:38:12.253011 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 290/578] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 12:38:12 2022] GET /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 12:38:12.313444 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-75357c6a-3d99-4fac-af4d-c663ca18875c tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:12.313961 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-75357c6a-3d99-4fac-af4d-c663ca18875c tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: f2e15c2c-04cc-435b-a633-39c4ae1a5e24] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:12.320406 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-75357c6a-3d99-4fac-af4d-c663ca18875c tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:12.320861 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-75357c6a-3d99-4fac-af4d-c663ca18875c tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:12.321709 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-75357c6a-3d99-4fac-af4d-c663ca18875c tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:12.322060 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-75357c6a-3d99-4fac-af4d-c663ca18875c tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:12.347516 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-75357c6a-3d99-4fac-af4d-c663ca18875c tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: f2e15c2c-04cc-435b-a633-39c4ae1a5e24] Going to try to terminate instance {{(pid=124199) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 12:38:12.391807 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:38:12.419381 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-f2194e08-a11f-4838-86f7-5e75d3c506e6 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:12.420079 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-f2194e08-a11f-4838-86f7-5e75d3c506e6 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 9a267457-7f06-4312-87ce-2c47cdb2924d] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:12.426875 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f2194e08-a11f-4838-86f7-5e75d3c506e6 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:12.427638 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f2194e08-a11f-4838-86f7-5e75d3c506e6 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:12.428853 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f2194e08-a11f-4838-86f7-5e75d3c506e6 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:12.429639 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f2194e08-a11f-4838-86f7-5e75d3c506e6 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:12.434750 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-75357c6a-3d99-4fac-af4d-c663ca18875c tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24" status: 204 len: 0 microversion: 2.1 time: 0.125070 May 23 12:38:12.435579 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 289/579] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 12:38:12 2022] DELETE /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 12:38:12.443510 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-491846db-4280-4b47-a95f-e5d35ae6616e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:12.444226 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-491846db-4280-4b47-a95f-e5d35ae6616e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: f2e15c2c-04cc-435b-a633-39c4ae1a5e24] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:12.451570 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-491846db-4280-4b47-a95f-e5d35ae6616e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:12.452022 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-491846db-4280-4b47-a95f-e5d35ae6616e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:12.453539 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-491846db-4280-4b47-a95f-e5d35ae6616e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:12.453981 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-491846db-4280-4b47-a95f-e5d35ae6616e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:12.630680 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-f2194e08-a11f-4838-86f7-5e75d3c506e6 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:12.639079 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-f2194e08-a11f-4838-86f7-5e75d3c506e6 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d" status: 200 len: 1362 microversion: 2.1 time: 0.224617 May 23 12:38:12.639664 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 291/580] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:38:12 2022] GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d => generated 1362 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:38:12.650501 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-491846db-4280-4b47-a95f-e5d35ae6616e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:12.658044 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-491846db-4280-4b47-a95f-e5d35ae6616e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24" status: 200 len: 1681 microversion: 2.1 time: 0.218421 May 23 12:38:12.658609 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 290/581] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:38:12 2022] GET /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24 => generated 1681 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:38:13.656853 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-6b5d802e-1990-475e-89f7-e814be5754f3 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:13.657460 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-6b5d802e-1990-475e-89f7-e814be5754f3 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 9a267457-7f06-4312-87ce-2c47cdb2924d] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:13.664038 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6b5d802e-1990-475e-89f7-e814be5754f3 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:13.664521 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6b5d802e-1990-475e-89f7-e814be5754f3 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:13.665281 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6b5d802e-1990-475e-89f7-e814be5754f3 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:13.666244 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6b5d802e-1990-475e-89f7-e814be5754f3 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:13.674664 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-ab7d7491-4b4f-4022-abbd-a0c743b898f9 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:13.675307 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-ab7d7491-4b4f-4022-abbd-a0c743b898f9 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: f2e15c2c-04cc-435b-a633-39c4ae1a5e24] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:13.682388 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ab7d7491-4b4f-4022-abbd-a0c743b898f9 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:13.683049 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ab7d7491-4b4f-4022-abbd-a0c743b898f9 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:13.683898 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ab7d7491-4b4f-4022-abbd-a0c743b898f9 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:13.684374 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ab7d7491-4b4f-4022-abbd-a0c743b898f9 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:13.864811 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-6b5d802e-1990-475e-89f7-e814be5754f3 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:13.869627 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-ab7d7491-4b4f-4022-abbd-a0c743b898f9 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:13.873632 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-6b5d802e-1990-475e-89f7-e814be5754f3 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d" status: 200 len: 1362 microversion: 2.1 time: 0.220562 May 23 12:38:13.874208 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 292/582] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:38:13 2022] GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:38:13.877535 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-ab7d7491-4b4f-4022-abbd-a0c743b898f9 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24" status: 200 len: 1681 microversion: 2.1 time: 0.206645 May 23 12:38:13.878174 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 291/583] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:38:13 2022] GET /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24 => generated 1681 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:38:14.124090 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-00aefa49-bf32-4d55-9a33-05cfb8f63a25 req-5d30d163-90bc-4cd9-be02-10cc55238ab9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a267457-7f06-4312-87ce-2c47cdb2924d", "name": "network-vif-plugged", "status": "completed", "tag": "b8447d6b-c07d-4b91-8b57-270b92719707"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:38:14.133906 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-00aefa49-bf32-4d55-9a33-05cfb8f63a25 req-5d30d163-90bc-4cd9-be02-10cc55238ab9 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:14.135277 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-00aefa49-bf32-4d55-9a33-05cfb8f63a25 req-5d30d163-90bc-4cd9-be02-10cc55238ab9 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:14.148794 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-00aefa49-bf32-4d55-9a33-05cfb8f63a25 req-5d30d163-90bc-4cd9-be02-10cc55238ab9 service nova] Creating event network-vif-plugged:b8447d6b-c07d-4b91-8b57-270b92719707 for instance 9a267457-7f06-4312-87ce-2c47cdb2924d on hv-cinder-83699 May 23 12:38:14.154139 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-00aefa49-bf32-4d55-9a33-05cfb8f63a25 req-5d30d163-90bc-4cd9-be02-10cc55238ab9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033974 May 23 12:38:14.155173 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 293/584] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:38:14.898620 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0008e2f4-20f2-4609-a391-27d119b2a627 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:14.899308 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-0008e2f4-20f2-4609-a391-27d119b2a627 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 9a267457-7f06-4312-87ce-2c47cdb2924d] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:14.900641 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-92bdda78-f122-4f92-885e-055e33fcade7 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:14.901446 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-92bdda78-f122-4f92-885e-055e33fcade7 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: f2e15c2c-04cc-435b-a633-39c4ae1a5e24] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:14.905820 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0008e2f4-20f2-4609-a391-27d119b2a627 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:14.906285 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0008e2f4-20f2-4609-a391-27d119b2a627 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:14.907072 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0008e2f4-20f2-4609-a391-27d119b2a627 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:14.907699 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0008e2f4-20f2-4609-a391-27d119b2a627 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:14.908521 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-92bdda78-f122-4f92-885e-055e33fcade7 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:14.909038 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-92bdda78-f122-4f92-885e-055e33fcade7 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:14.910042 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-92bdda78-f122-4f92-885e-055e33fcade7 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:14.910485 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-92bdda78-f122-4f92-885e-055e33fcade7 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:14.999174 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-92bdda78-f122-4f92-885e-055e33fcade7 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:15.007236 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-92bdda78-f122-4f92-885e-055e33fcade7 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24" status: 200 len: 1613 microversion: 2.1 time: 0.110934 May 23 12:38:15.017111 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 294/585] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:38:14 2022] GET /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24 => generated 1613 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:38:15.017111 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-37b2150e-20a6-44a7-b6b8-9d15376cb68d req-5cf0c246-9e69-4e18-a066-553614162fcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2e15c2c-04cc-435b-a633-39c4ae1a5e24", "name": "network-vif-deleted", "tag": "e4be8f3d-d13e-41b9-8480-75814c3ff785"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:38:15.022713 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-37b2150e-20a6-44a7-b6b8-9d15376cb68d req-5cf0c246-9e69-4e18-a066-553614162fcc service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:15.023166 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-37b2150e-20a6-44a7-b6b8-9d15376cb68d req-5cf0c246-9e69-4e18-a066-553614162fcc service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:15.037666 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-37b2150e-20a6-44a7-b6b8-9d15376cb68d req-5cf0c246-9e69-4e18-a066-553614162fcc service nova] Creating event network-vif-deleted:e4be8f3d-d13e-41b9-8480-75814c3ff785 for instance f2e15c2c-04cc-435b-a633-39c4ae1a5e24 on hv-cinder-83699 May 23 12:38:15.045726 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-37b2150e-20a6-44a7-b6b8-9d15376cb68d req-5cf0c246-9e69-4e18-a066-553614162fcc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035282 May 23 12:38:15.046747 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 295/586] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:38:15.074399 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0008e2f4-20f2-4609-a391-27d119b2a627 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:15.082258 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-0008e2f4-20f2-4609-a391-27d119b2a627 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d" status: 200 len: 1362 microversion: 2.1 time: 0.188757 May 23 12:38:15.082772 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 292/587] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:38:14 2022] GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:38:16.026565 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-0f95ac0a-8a9c-4747-b5d0-1cf23e104784 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:16.027271 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-0f95ac0a-8a9c-4747-b5d0-1cf23e104784 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: f2e15c2c-04cc-435b-a633-39c4ae1a5e24] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:16.033766 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0f95ac0a-8a9c-4747-b5d0-1cf23e104784 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:16.034225 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0f95ac0a-8a9c-4747-b5d0-1cf23e104784 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:16.035005 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0f95ac0a-8a9c-4747-b5d0-1cf23e104784 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:16.035447 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0f95ac0a-8a9c-4747-b5d0-1cf23e104784 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:16.067202 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0f95ac0a-8a9c-4747-b5d0-1cf23e104784 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:16.067831 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0f95ac0a-8a9c-4747-b5d0-1cf23e104784 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:16.068330 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.objects.instance [None req-0f95ac0a-8a9c-4747-b5d0-1cf23e104784 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lazy-loading 'fault' on Instance uuid f2e15c2c-04cc-435b-a633-39c4ae1a5e24 {{(pid=124200) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:38:16.099171 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-1dd3ed8f-146b-43a3-9544-847152d28563 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:16.099852 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-1dd3ed8f-146b-43a3-9544-847152d28563 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 9a267457-7f06-4312-87ce-2c47cdb2924d] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:16.107085 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1dd3ed8f-146b-43a3-9544-847152d28563 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:16.107619 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1dd3ed8f-146b-43a3-9544-847152d28563 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:16.108549 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1dd3ed8f-146b-43a3-9544-847152d28563 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:16.109215 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1dd3ed8f-146b-43a3-9544-847152d28563 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:16.112143 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-0f95ac0a-8a9c-4747-b5d0-1cf23e104784 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:16.119668 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-0f95ac0a-8a9c-4747-b5d0-1cf23e104784 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24" status: 200 len: 1331 microversion: 2.1 time: 0.098535 May 23 12:38:16.120459 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 296/588] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:38:16 2022] GET /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24 => generated 1331 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:38:16.250839 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1dd3ed8f-146b-43a3-9544-847152d28563 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:16.259272 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-1dd3ed8f-146b-43a3-9544-847152d28563 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d" status: 200 len: 1547 microversion: 2.1 time: 0.163847 May 23 12:38:16.260474 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 293/589] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:38:16 2022] GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d => generated 1547 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:38:16.276123 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-a055b9d7-ecf8-4956-856d-a635a96a2b0d tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:16.276656 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-a055b9d7-ecf8-4956-856d-a635a96a2b0d tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 9a267457-7f06-4312-87ce-2c47cdb2924d] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:16.282694 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a055b9d7-ecf8-4956-856d-a635a96a2b0d tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:16.283147 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a055b9d7-ecf8-4956-856d-a635a96a2b0d tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:16.283925 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a055b9d7-ecf8-4956-856d-a635a96a2b0d tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:16.284397 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a055b9d7-ecf8-4956-856d-a635a96a2b0d tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:16.361672 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-a055b9d7-ecf8-4956-856d-a635a96a2b0d tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089520 May 23 12:38:16.362270 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 297/590] 10.222.0.16 () {58 vars in 1274 bytes} [Mon May 23 12:38:16 2022] GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:38:17.136924 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0e25af78-dce3-40ac-ad0e-059220b3c090 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:17.137539 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-0e25af78-dce3-40ac-ad0e-059220b3c090 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: f2e15c2c-04cc-435b-a633-39c4ae1a5e24] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:17.139565 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell0:SELECT=6 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:38:17.145511 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0e25af78-dce3-40ac-ad0e-059220b3c090 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:17.145965 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0e25af78-dce3-40ac-ad0e-059220b3c090 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:17.146734 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0e25af78-dce3-40ac-ad0e-059220b3c090 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:17.147171 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0e25af78-dce3-40ac-ad0e-059220b3c090 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:17.161196 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.wsgi [None req-0e25af78-dce3-40ac-ad0e-059220b3c090 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] HTTP exception thrown: Instance f2e15c2c-04cc-435b-a633-39c4ae1a5e24 could not be found. May 23 12:38:17.162827 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0e25af78-dce3-40ac-ad0e-059220b3c090 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Request method failure captured: May 23 12:38:17.162827 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: request: GET /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24 HTTP/1.1 May 23 12:38:17.162827 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept: application/json May 23 12:38:17.162827 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept-Encoding: identity May 23 12:38:17.162827 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Connection: close May 23 12:38:17.162827 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Length: 0 May 23 12:38:17.162827 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Type: application/json May 23 12:38:17.162827 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Host: 10.222.0.16 May 23 12:38:17.162827 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Openstack-System-Scope: None May 23 12:38:17.162827 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: User-Agent: python-urllib3/1.26.9 May 23 12:38:17.162827 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Auth-Token: gAAAAABii38ZU7Vwsw5AAU8G7deCk06Tjsg_k90-PVfeWrd3aNHg-oGVBFwUfnF7AZgHGAQrHmO4XQOE1Bz6uWE6i2CAUoXJsEuLNZGXvkqTPiv0H7N4ZSkFEsbSkgm2LM1J6iSbSGefN_01pdctKfH8BgGpUswrmPhK0nZLP7jsVPYKp_z7ea8 May 23 12:38:17.162827 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Id: None May 23 12:38:17.162827 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Name: None May 23 12:38:17.162827 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Identity-Status: Confirmed May 23 12:38:17.162827 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Is-Admin-Project: True May 23 12:38:17.162827 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Id: default May 23 12:38:17.162827 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Name: Default May 23 12:38:17.162827 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Id: da82f9c566664cb1a974cf0d1bf1b09d May 23 12:38:17.162827 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Name: tempest-AttachVolumeNegativeTest-2053273606 May 23 12:38:17.162827 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Role: member,reader May 23 12:38:17.162827 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Roles: member,reader May 23 12:38:17.164571 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da82f9c566664cb1a974cf0d1bf1b09d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da82f9c566664cb1a974cf0d1bf1b09d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da82f9c566664cb1a974cf0d1bf1b09d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da82f9c566664cb1a974cf0d1bf1b09d"}]}] May 23 12:38:17.164571 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant: tempest-AttachVolumeNegativeTest-2053273606 May 23 12:38:17.164571 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Id: da82f9c566664cb1a974cf0d1bf1b09d May 23 12:38:17.164571 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2053273606 May 23 12:38:17.164571 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User: tempest-AttachVolumeNegativeTest-2053273606-project May 23 12:38:17.164571 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Id: default May 23 12:38:17.164571 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Name: Default May 23 12:38:17.164571 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Id: ef222fe025534a9e942f8c5c4ed1e3e7 May 23 12:38:17.164571 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Name: tempest-AttachVolumeNegativeTest-2053273606-project May 23 12:38:17.164571 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: method: > May 23 12:38:17.164571 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: exception: Instance f2e15c2c-04cc-435b-a633-39c4ae1a5e24 could not be found. May 23 12:38:17.164571 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: action_args: {'id': 'f2e15c2c-04cc-435b-a633-39c4ae1a5e24'} May 23 12:38:17.166320 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:38:17.166320 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:38:17.166320 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:38:17.166320 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:38:17.166320 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:38:17.166320 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:38:17.166320 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:38:17.166320 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:38:17.166320 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:38:17.166320 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:38:17.166320 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2e15c2c-04cc-435b-a633-39c4ae1a5e24 could not be found. May 23 12:38:17.166320 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:38:17.166320 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:38:17.166320 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:38:17.166320 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:38:17.166320 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:38:17.166320 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:38:17.166320 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:38:17.166320 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:38:17.166320 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:38:17.167707 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:38:17.167707 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:38:17.167707 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:38:17.167707 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:38:17.167707 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:38:17.167707 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:38:17.167707 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:38:17.167707 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2e15c2c-04cc-435b-a633-39c4ae1a5e24 could not be found. May 23 12:38:17.167707 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:38:17.167707 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:38:17.167707 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:38:17.167707 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:38:17.167707 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:38:17.167707 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:38:17.167707 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:38:17.167707 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:38:17.167707 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2e15c2c-04cc-435b-a633-39c4ae1a5e24 could not be found. May 23 12:38:17.167707 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:38:17.168925 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0e25af78-dce3-40ac-ad0e-059220b3c090 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Returning 404 to user: Instance f2e15c2c-04cc-435b-a633-39c4ae1a5e24 could not be found. {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:38:17.168925 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-0e25af78-dce3-40ac-ad0e-059220b3c090 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24" status: 404 len: 111 microversion: 2.1 time: 0.031453 May 23 12:38:17.168925 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 294/591] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:38:17 2022] GET /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:38:17.171438 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell0:SELECT=2 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:38:17.172504 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell0:SELECT=6 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:38:17.176795 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-168a4552-037b-46f7-8b7d-858d0e80dc46 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '.version_select at 0x7f095c95f310>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:17.196327 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-168a4552-037b-46f7-8b7d-858d0e80dc46 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1527802113" status: 202 len: 0 microversion: 2.1 time: 0.025594 May 23 12:38:17.197094 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 298/592] 10.222.0.16 () {58 vars in 1220 bytes} [Mon May 23 12:38:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1527802113 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:38:17.542470 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-6e1412e3-f9d8-43e8-8db0-6c4a666ccf20 req-841b8727-4d3d-4caf-b485-8439bc819cf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a267457-7f06-4312-87ce-2c47cdb2924d", "tag": "b8447d6b-c07d-4b91-8b57-270b92719707"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:38:17.550771 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-6e1412e3-f9d8-43e8-8db0-6c4a666ccf20 req-841b8727-4d3d-4caf-b485-8439bc819cf1 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:17.551622 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-6e1412e3-f9d8-43e8-8db0-6c4a666ccf20 req-841b8727-4d3d-4caf-b485-8439bc819cf1 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:17.563645 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-6e1412e3-f9d8-43e8-8db0-6c4a666ccf20 req-841b8727-4d3d-4caf-b485-8439bc819cf1 service nova] Creating event network-changed:b8447d6b-c07d-4b91-8b57-270b92719707 for instance 9a267457-7f06-4312-87ce-2c47cdb2924d on hv-cinder-83699 May 23 12:38:17.568560 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-6e1412e3-f9d8-43e8-8db0-6c4a666ccf20 req-841b8727-4d3d-4caf-b485-8439bc819cf1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029670 May 23 12:38:17.573167 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 295/593] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:38:18.097418 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-8f5c96ab-c866-4f2d-b93b-3491453c6a21 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Action: 'create', calling method: .version_select at 0x7f095c95e820>, body: {"keypair": {"name": "tempest-keypair-2127905694", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCp9V/ulZshlxv0+gLYsx7RMq13cw9O2jZ2euZZ5qK8nVslfqqqR2G1plbeGGT3IwM9RSij7dPrT+b29yaHi8BVCAAdGYw37K61nVTMW3kA58TV9vXz9fqVznnbhSb8vwA=="}} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:38:18.114407 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.quota [None req-8f5c96ab-c866-4f2d-b93b-3491453c6a21 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Getting quotas for project da82f9c566664cb1a974cf0d1bf1b09d. Resources: {'key_pairs'} {{(pid=124200) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:38:18.119413 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.quota [None req-8f5c96ab-c866-4f2d-b93b-3491453c6a21 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Getting quotas for user ef222fe025534a9e942f8c5c4ed1e3e7 and project da82f9c566664cb1a974cf0d1bf1b09d. Resources: {'key_pairs'} {{(pid=124200) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:38:18.144918 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-8f5c96ab-c866-4f2d-b93b-3491453c6a21 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051511 May 23 12:38:18.146113 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 299/594] 10.222.0.16 () {60 vars in 1158 bytes} [Mon May 23 12:38:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:38:19.462782 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-2e232952-10c2-4a7e-b483-4bee0d8c2e3f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1054036936", "imageRef": "bb11dfa4-2977-4163-8237-78c871c8437f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "34e447e2-b5a8-48e8-88c3-11c08d0cb74a"}], "security_groups": [{"name": "tempest-securitygroup--1660524520"}], "key_name": "tempest-keypair-2127905694", "user_data": "}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:38:19.567588 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.network.neutron [None req-2e232952-10c2-4a7e-b483-4bee0d8c2e3f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] validate_networks() for [('34e447e2-b5a8-48e8-88c3-11c08d0cb74a', None, None, None, None, None)] {{(pid=124199) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 12:38:19.975526 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-2e232952-10c2-4a7e-b483-4bee0d8c2e3f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Flavor limits 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 12:38:19.975980 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-2e232952-10c2-4a7e-b483-4bee0d8c2e3f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Image limits 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 12:38:19.976495 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-2e232952-10c2-4a7e-b483-4bee0d8c2e3f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Flavor pref 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 12:38:19.976904 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-2e232952-10c2-4a7e-b483-4bee0d8c2e3f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Image pref 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 12:38:19.977316 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-2e232952-10c2-4a7e-b483-4bee0d8c2e3f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 12:38:19.986279 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2e232952-10c2-4a7e-b483-4bee0d8c2e3f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:19.986727 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2e232952-10c2-4a7e-b483-4bee0d8c2e3f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:19.987527 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2e232952-10c2-4a7e-b483-4bee0d8c2e3f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:19.987968 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2e232952-10c2-4a7e-b483-4bee0d8c2e3f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:20.004897 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-2e232952-10c2-4a7e-b483-4bee0d8c2e3f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Getting quotas for project da82f9c566664cb1a974cf0d1bf1b09d. Resources: {'instances', 'cores', 'ram'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:38:20.008810 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-2e232952-10c2-4a7e-b483-4bee0d8c2e3f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Getting quotas for user ef222fe025534a9e942f8c5c4ed1e3e7 and project da82f9c566664cb1a974cf0d1bf1b09d. Resources: {'instances', 'cores', 'ram'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:38:20.020908 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-2e232952-10c2-4a7e-b483-4bee0d8c2e3f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Going to run 1 instances... {{(pid=124199) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 12:38:20.023338 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-2e232952-10c2-4a7e-b483-4bee0d8c2e3f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 203877da-d78e-44f0-bc6a-995008fef4f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb11dfa4-2977-4163-8237-78c871c8437f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124199) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 12:38:20.071111 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-2e232952-10c2-4a7e-b483-4bee0d8c2e3f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.613816 May 23 12:38:20.072377 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 296/595] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 23 12:38:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 12:38:20.083405 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-bd020ba5-36e3-4ad5-99e4-8742948fd4f5 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:20.084018 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-bd020ba5-36e3-4ad5-99e4-8742948fd4f5 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 203877da-d78e-44f0-bc6a-995008fef4f7] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:20.151049 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-bd020ba5-36e3-4ad5-99e4-8742948fd4f5 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:20.157789 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-bd020ba5-36e3-4ad5-99e4-8742948fd4f5 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7" status: 200 len: 1242 microversion: 2.1 time: 0.078933 May 23 12:38:20.158349 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 300/596] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:38:20 2022] GET /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7 => generated 1242 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:38:21.175288 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0983f318-19d0-4e3a-b5ee-9977f008cace tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:21.175909 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-0983f318-19d0-4e3a-b5ee-9977f008cace tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 203877da-d78e-44f0-bc6a-995008fef4f7] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:21.182647 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0983f318-19d0-4e3a-b5ee-9977f008cace tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:21.183103 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0983f318-19d0-4e3a-b5ee-9977f008cace tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:21.183885 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0983f318-19d0-4e3a-b5ee-9977f008cace tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:21.184372 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0983f318-19d0-4e3a-b5ee-9977f008cace tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:21.262045 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0983f318-19d0-4e3a-b5ee-9977f008cace tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:21.270053 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-0983f318-19d0-4e3a-b5ee-9977f008cace tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7" status: 200 len: 1302 microversion: 2.1 time: 0.099093 May 23 12:38:21.270625 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 297/597] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:38:21 2022] GET /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7 => generated 1302 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:38:22.286934 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-6c3e4167-9979-4ae2-b1e0-d1952413c9e2 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:22.287500 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-6c3e4167-9979-4ae2-b1e0-d1952413c9e2 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 203877da-d78e-44f0-bc6a-995008fef4f7] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:22.296635 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6c3e4167-9979-4ae2-b1e0-d1952413c9e2 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:22.297080 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6c3e4167-9979-4ae2-b1e0-d1952413c9e2 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:22.297929 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6c3e4167-9979-4ae2-b1e0-d1952413c9e2 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:22.298476 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6c3e4167-9979-4ae2-b1e0-d1952413c9e2 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:22.435471 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-6c3e4167-9979-4ae2-b1e0-d1952413c9e2 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:22.444302 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-6c3e4167-9979-4ae2-b1e0-d1952413c9e2 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7" status: 200 len: 1368 microversion: 2.1 time: 0.160899 May 23 12:38:22.445559 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 301/598] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:38:22 2022] GET /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:38:22.664497 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-51a46161-0684-4e80-a954-86bf923c3088 req-54fb376b-bad9-4c83-a168-627293c1e9c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "203877da-d78e-44f0-bc6a-995008fef4f7", "tag": "ffc6e408-2088-45a7-824d-4afc170af6a4"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:38:22.690541 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-51a46161-0684-4e80-a954-86bf923c3088 req-54fb376b-bad9-4c83-a168-627293c1e9c8 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:22.691192 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-51a46161-0684-4e80-a954-86bf923c3088 req-54fb376b-bad9-4c83-a168-627293c1e9c8 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:22.704081 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-51a46161-0684-4e80-a954-86bf923c3088 req-54fb376b-bad9-4c83-a168-627293c1e9c8 service nova] Creating event network-changed:ffc6e408-2088-45a7-824d-4afc170af6a4 for instance 203877da-d78e-44f0-bc6a-995008fef4f7 on hv-cinder-83699 May 23 12:38:22.709048 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-51a46161-0684-4e80-a954-86bf923c3088 req-54fb376b-bad9-4c83-a168-627293c1e9c8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048666 May 23 12:38:22.709677 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 298/599] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:38:23.467456 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-0932b219-8c74-4a02-873a-634603850ac3 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:23.468068 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-0932b219-8c74-4a02-873a-634603850ac3 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 203877da-d78e-44f0-bc6a-995008fef4f7] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:23.474628 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0932b219-8c74-4a02-873a-634603850ac3 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:23.475078 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0932b219-8c74-4a02-873a-634603850ac3 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:23.475847 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0932b219-8c74-4a02-873a-634603850ac3 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:23.476316 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0932b219-8c74-4a02-873a-634603850ac3 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:23.612657 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-0932b219-8c74-4a02-873a-634603850ac3 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:23.620394 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-0932b219-8c74-4a02-873a-634603850ac3 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7" status: 200 len: 1368 microversion: 2.1 time: 0.159146 May 23 12:38:23.620962 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 302/600] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:38:23 2022] GET /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:38:24.639125 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-85d80138-5ff3-4cd8-ac50-07c5032bbe2f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:24.639833 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-85d80138-5ff3-4cd8-ac50-07c5032bbe2f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 203877da-d78e-44f0-bc6a-995008fef4f7] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:24.646440 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-85d80138-5ff3-4cd8-ac50-07c5032bbe2f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:24.646879 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-85d80138-5ff3-4cd8-ac50-07c5032bbe2f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:24.647911 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-85d80138-5ff3-4cd8-ac50-07c5032bbe2f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:24.648594 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-85d80138-5ff3-4cd8-ac50-07c5032bbe2f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:24.783350 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-85d80138-5ff3-4cd8-ac50-07c5032bbe2f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:24.791674 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-85d80138-5ff3-4cd8-ac50-07c5032bbe2f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7" status: 200 len: 1368 microversion: 2.1 time: 0.158020 May 23 12:38:24.792266 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 299/601] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:38:24 2022] GET /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:38:25.808476 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-df4a8876-fe59-4032-8e24-60079958f123 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:25.809081 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-df4a8876-fe59-4032-8e24-60079958f123 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 203877da-d78e-44f0-bc6a-995008fef4f7] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:25.815576 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-df4a8876-fe59-4032-8e24-60079958f123 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:25.816022 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-df4a8876-fe59-4032-8e24-60079958f123 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:25.816813 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-df4a8876-fe59-4032-8e24-60079958f123 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:25.817248 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-df4a8876-fe59-4032-8e24-60079958f123 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:25.953787 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-df4a8876-fe59-4032-8e24-60079958f123 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:25.961301 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-df4a8876-fe59-4032-8e24-60079958f123 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7" status: 200 len: 1368 microversion: 2.1 time: 0.156693 May 23 12:38:25.961865 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 303/602] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:38:25 2022] GET /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:38:26.978210 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-7efb1a62-8137-4952-af11-457db2c406fd tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:26.978820 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-7efb1a62-8137-4952-af11-457db2c406fd tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 203877da-d78e-44f0-bc6a-995008fef4f7] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:26.986755 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7efb1a62-8137-4952-af11-457db2c406fd tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:26.987197 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7efb1a62-8137-4952-af11-457db2c406fd tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:26.987959 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7efb1a62-8137-4952-af11-457db2c406fd tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:26.988416 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7efb1a62-8137-4952-af11-457db2c406fd tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:27.118516 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-7efb1a62-8137-4952-af11-457db2c406fd tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:27.126259 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-7efb1a62-8137-4952-af11-457db2c406fd tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7" status: 200 len: 1368 microversion: 2.1 time: 0.151876 May 23 12:38:27.126817 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 300/603] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:38:26 2022] GET /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:38:28.143708 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-f1372db4-b74c-454c-b3ef-44618e98ef26 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:28.144291 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-f1372db4-b74c-454c-b3ef-44618e98ef26 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 203877da-d78e-44f0-bc6a-995008fef4f7] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:28.151046 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f1372db4-b74c-454c-b3ef-44618e98ef26 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:28.151581 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f1372db4-b74c-454c-b3ef-44618e98ef26 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:28.152828 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f1372db4-b74c-454c-b3ef-44618e98ef26 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:28.153278 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f1372db4-b74c-454c-b3ef-44618e98ef26 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:28.190077 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-9768adc8-a16a-49a6-a6d1-5a07d7b4bdbd req-a8edccac-f577-46ce-ac66-1e935f7b2e07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "203877da-d78e-44f0-bc6a-995008fef4f7", "name": "network-vif-plugged", "status": "completed", "tag": "ffc6e408-2088-45a7-824d-4afc170af6a4"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:38:28.201557 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-9768adc8-a16a-49a6-a6d1-5a07d7b4bdbd req-a8edccac-f577-46ce-ac66-1e935f7b2e07 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:28.202231 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-9768adc8-a16a-49a6-a6d1-5a07d7b4bdbd req-a8edccac-f577-46ce-ac66-1e935f7b2e07 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:28.215476 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-9768adc8-a16a-49a6-a6d1-5a07d7b4bdbd req-a8edccac-f577-46ce-ac66-1e935f7b2e07 service nova] Creating event network-vif-plugged:ffc6e408-2088-45a7-824d-4afc170af6a4 for instance 203877da-d78e-44f0-bc6a-995008fef4f7 on hv-cinder-83699 May 23 12:38:28.220884 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-9768adc8-a16a-49a6-a6d1-5a07d7b4bdbd req-a8edccac-f577-46ce-ac66-1e935f7b2e07 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035138 May 23 12:38:28.222081 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 301/604] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:38:28.297232 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-f1372db4-b74c-454c-b3ef-44618e98ef26 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:28.304632 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-f1372db4-b74c-454c-b3ef-44618e98ef26 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7" status: 200 len: 1368 microversion: 2.1 time: 0.165287 May 23 12:38:28.305318 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 304/605] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:38:28 2022] GET /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:38:29.323813 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c37f837e-4366-4844-8c56-cafdd9624630 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:29.324700 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c37f837e-4366-4844-8c56-cafdd9624630 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 203877da-d78e-44f0-bc6a-995008fef4f7] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:29.331117 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c37f837e-4366-4844-8c56-cafdd9624630 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:29.331566 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c37f837e-4366-4844-8c56-cafdd9624630 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:29.332361 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c37f837e-4366-4844-8c56-cafdd9624630 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:29.332801 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c37f837e-4366-4844-8c56-cafdd9624630 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:29.464805 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c37f837e-4366-4844-8c56-cafdd9624630 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:29.472394 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c37f837e-4366-4844-8c56-cafdd9624630 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7" status: 200 len: 1368 microversion: 2.1 time: 0.153773 May 23 12:38:29.472951 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 302/606] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:38:29 2022] GET /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:38:30.490217 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell0:SELECT=6 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:38:30.549160 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-2f6aa057-166c-44db-890d-08741fb49ec0 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:30.549764 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-2f6aa057-166c-44db-890d-08741fb49ec0 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 203877da-d78e-44f0-bc6a-995008fef4f7] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:30.556065 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2f6aa057-166c-44db-890d-08741fb49ec0 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:30.556493 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2f6aa057-166c-44db-890d-08741fb49ec0 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:30.557251 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2f6aa057-166c-44db-890d-08741fb49ec0 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:30.557683 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2f6aa057-166c-44db-890d-08741fb49ec0 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:30.692849 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-2f6aa057-166c-44db-890d-08741fb49ec0 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:30.700687 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-2f6aa057-166c-44db-890d-08741fb49ec0 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7" status: 200 len: 1557 microversion: 2.1 time: 0.215464 May 23 12:38:30.701257 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 305/607] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:38:30 2022] GET /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7 => generated 1557 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:38:30.717944 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-7e203984-e3e8-453c-b036-15a7ac9ce487 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:30.718470 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-7e203984-e3e8-453c-b036-15a7ac9ce487 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 203877da-d78e-44f0-bc6a-995008fef4f7] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:30.720538 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell0:SELECT=2 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:38:30.721314 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell0:SELECT=6 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:38:30.726869 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7e203984-e3e8-453c-b036-15a7ac9ce487 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:30.727462 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7e203984-e3e8-453c-b036-15a7ac9ce487 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:30.729110 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7e203984-e3e8-453c-b036-15a7ac9ce487 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:30.729542 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7e203984-e3e8-453c-b036-15a7ac9ce487 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:30.811474 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-7e203984-e3e8-453c-b036-15a7ac9ce487 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097279 May 23 12:38:30.812061 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 303/608] 10.222.0.16 () {58 vars in 1274 bytes} [Mon May 23 12:38:30 2022] GET /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:38:31.740942 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-3f23abf1-35cf-488b-bcb1-3ba9ff3934cb req-106b187b-f4c0-4802-9001-7f4ea6c96c3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "203877da-d78e-44f0-bc6a-995008fef4f7", "tag": "ffc6e408-2088-45a7-824d-4afc170af6a4"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:38:31.750253 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-3f23abf1-35cf-488b-bcb1-3ba9ff3934cb req-106b187b-f4c0-4802-9001-7f4ea6c96c3e service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:31.750703 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-3f23abf1-35cf-488b-bcb1-3ba9ff3934cb req-106b187b-f4c0-4802-9001-7f4ea6c96c3e service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:31.761749 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-3f23abf1-35cf-488b-bcb1-3ba9ff3934cb req-106b187b-f4c0-4802-9001-7f4ea6c96c3e service nova] Creating event network-changed:ffc6e408-2088-45a7-824d-4afc170af6a4 for instance 203877da-d78e-44f0-bc6a-995008fef4f7 on hv-cinder-83699 May 23 12:38:31.767190 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-3f23abf1-35cf-488b-bcb1-3ba9ff3934cb req-106b187b-f4c0-4802-9001-7f4ea6c96c3e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029866 May 23 12:38:31.767958 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 306/609] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:38:36.079699 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-49659d2c-16a5-4d02-9f2d-174b26a2eec8 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:36.080286 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-49659d2c-16a5-4d02-9f2d-174b26a2eec8 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:36.082093 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:38:36.088220 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-49659d2c-16a5-4d02-9f2d-174b26a2eec8 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:36.088663 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-49659d2c-16a5-4d02-9f2d-174b26a2eec8 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:36.089432 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-49659d2c-16a5-4d02-9f2d-174b26a2eec8 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:36.089871 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-49659d2c-16a5-4d02-9f2d-174b26a2eec8 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:36.171392 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.objects.instance [None req-49659d2c-16a5-4d02-9f2d-174b26a2eec8 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lazy-loading 'services' on Instance uuid 64486ed1-2721-4c2a-a2fb-a96f3a82f32f {{(pid=124199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:38:36.242723 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-49659d2c-16a5-4d02-9f2d-174b26a2eec8 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "DELETE /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f/os-volume_attachments/23e14746-9a92-488b-94ab-ebfe7513e9da" status: 202 len: 0 microversion: 2.1 time: 0.167656 May 23 12:38:36.243367 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 304/610] 10.222.0.16 () {58 vars in 1415 bytes} [Mon May 23 12:38:36 2022] DELETE /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f/os-volume_attachments/23e14746-9a92-488b-94ab-ebfe7513e9da => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:38:36.252764 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-d398a28c-6691-45da-aa7d-2636727c9613 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:36.253765 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-d398a28c-6691-45da-aa7d-2636727c9613 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:36.260559 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d398a28c-6691-45da-aa7d-2636727c9613 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:36.261011 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d398a28c-6691-45da-aa7d-2636727c9613 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:36.261787 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d398a28c-6691-45da-aa7d-2636727c9613 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:36.262226 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d398a28c-6691-45da-aa7d-2636727c9613 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:36.294186 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-d398a28c-6691-45da-aa7d-2636727c9613 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046186 May 23 12:38:36.298248 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 307/611] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 12:38:36 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:38:37.312470 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f2d7d5ed-ae49-47ba-bc95-f3cd229ce30e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:37.313596 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-f2d7d5ed-ae49-47ba-bc95-f3cd229ce30e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:37.319923 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f2d7d5ed-ae49-47ba-bc95-f3cd229ce30e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:37.320471 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f2d7d5ed-ae49-47ba-bc95-f3cd229ce30e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:37.322376 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f2d7d5ed-ae49-47ba-bc95-f3cd229ce30e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:37.322959 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f2d7d5ed-ae49-47ba-bc95-f3cd229ce30e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:37.353624 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f2d7d5ed-ae49-47ba-bc95-f3cd229ce30e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046032 May 23 12:38:37.354171 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 305/612] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 12:38:37 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 12:38:37.426070 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-388e132c-2bb8-431a-b8d6-dd55e0251998 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:37.426579 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-388e132c-2bb8-431a-b8d6-dd55e0251998 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:37.433779 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-388e132c-2bb8-431a-b8d6-dd55e0251998 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:37.434215 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-388e132c-2bb8-431a-b8d6-dd55e0251998 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:37.434979 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-388e132c-2bb8-431a-b8d6-dd55e0251998 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:37.435417 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-388e132c-2bb8-431a-b8d6-dd55e0251998 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:37.461286 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-388e132c-2bb8-431a-b8d6-dd55e0251998 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Going to try to terminate instance {{(pid=124200) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 12:38:37.538927 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-388e132c-2bb8-431a-b8d6-dd55e0251998 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "DELETE /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f" status: 204 len: 0 microversion: 2.1 time: 0.116667 May 23 12:38:37.539606 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 308/613] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 12:38:37 2022] DELETE /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 12:38:37.548785 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b4b84dc3-420a-4282-801e-d84a2b96bb4f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:37.549397 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-b4b84dc3-420a-4282-801e-d84a2b96bb4f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:37.555978 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b4b84dc3-420a-4282-801e-d84a2b96bb4f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:37.557073 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b4b84dc3-420a-4282-801e-d84a2b96bb4f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:37.557940 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b4b84dc3-420a-4282-801e-d84a2b96bb4f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:37.558383 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b4b84dc3-420a-4282-801e-d84a2b96bb4f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:37.692078 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b4b84dc3-420a-4282-801e-d84a2b96bb4f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:37.700316 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b4b84dc3-420a-4282-801e-d84a2b96bb4f tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f" status: 200 len: 1689 microversion: 2.1 time: 0.155244 May 23 12:38:37.700896 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 306/614] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:38:37 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:38:38.770471 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-77427e7c-f3de-4ce1-a00a-12b9d92a6b59 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:38.771181 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-77427e7c-f3de-4ce1-a00a-12b9d92a6b59 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:38.777239 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-77427e7c-f3de-4ce1-a00a-12b9d92a6b59 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:38.777684 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-77427e7c-f3de-4ce1-a00a-12b9d92a6b59 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:38.778445 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-77427e7c-f3de-4ce1-a00a-12b9d92a6b59 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:38.778879 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-77427e7c-f3de-4ce1-a00a-12b9d92a6b59 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:38.794041 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:38:38.913544 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-77427e7c-f3de-4ce1-a00a-12b9d92a6b59 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:38.923296 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-77427e7c-f3de-4ce1-a00a-12b9d92a6b59 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f" status: 200 len: 1689 microversion: 2.1 time: 0.209253 May 23 12:38:38.923873 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 309/615] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:38:38 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f => generated 1689 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:38:39.675529 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-3db90b47-1e37-4180-af14-3efef443ac82 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:39.676034 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-3db90b47-1e37-4180-af14-3efef443ac82 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:39.681988 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3db90b47-1e37-4180-af14-3efef443ac82 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:39.682434 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3db90b47-1e37-4180-af14-3efef443ac82 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:39.683190 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3db90b47-1e37-4180-af14-3efef443ac82 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:39.683648 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3db90b47-1e37-4180-af14-3efef443ac82 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:39.707212 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-3db90b47-1e37-4180-af14-3efef443ac82 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654/ips" status: 200 len: 152 microversion: 2.20 time: 0.091415 May 23 12:38:39.707762 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 307/616] 10.222.0.16 () {60 vars in 1288 bytes} [Mon May 23 12:38:39 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654/ips => generated 152 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 12:38:39.942561 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-fab3ad43-2553-4ed9-b74d-72276522e872 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:39.943324 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-fab3ad43-2553-4ed9-b74d-72276522e872 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:39.945664 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:38:39.952194 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-fab3ad43-2553-4ed9-b74d-72276522e872 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:39.952651 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-fab3ad43-2553-4ed9-b74d-72276522e872 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:39.953726 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-fab3ad43-2553-4ed9-b74d-72276522e872 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:39.954164 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-fab3ad43-2553-4ed9-b74d-72276522e872 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:40.095557 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-fab3ad43-2553-4ed9-b74d-72276522e872 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:40.102990 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-fab3ad43-2553-4ed9-b74d-72276522e872 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f" status: 200 len: 1689 microversion: 2.1 time: 0.165958 May 23 12:38:40.103572 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 310/617] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:38:39 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:38:41.120555 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c7bee189-903a-482e-9494-73d868586148 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:41.122163 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c7bee189-903a-482e-9494-73d868586148 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:41.128824 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c7bee189-903a-482e-9494-73d868586148 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:41.129273 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c7bee189-903a-482e-9494-73d868586148 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:41.130038 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c7bee189-903a-482e-9494-73d868586148 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:41.130473 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c7bee189-903a-482e-9494-73d868586148 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:41.260938 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c7bee189-903a-482e-9494-73d868586148 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:41.268777 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c7bee189-903a-482e-9494-73d868586148 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f" status: 200 len: 1689 microversion: 2.1 time: 0.151994 May 23 12:38:41.269338 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 308/618] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:38:41 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:38:41.957533 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-5647713c-12be-40a9-bed1-ec1515b320f3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:38:41.958211 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-5647713c-12be-40a9-bed1-ec1515b320f3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:41.966955 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5647713c-12be-40a9-bed1-ec1515b320f3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:41.967567 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5647713c-12be-40a9-bed1-ec1515b320f3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:41.969740 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5647713c-12be-40a9-bed1-ec1515b320f3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:41.970300 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5647713c-12be-40a9-bed1-ec1515b320f3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:41.994252 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.objects.instance [None req-5647713c-12be-40a9-bed1-ec1515b320f3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lazy-loading 'flavor' on Instance uuid 40320b2c-6137-4266-b3b6-fb76f3d6d654 {{(pid=124200) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:38:42.275617 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-5647713c-12be-40a9-bed1-ec1515b320f3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "POST /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654/action" status: 202 len: 0 microversion: 2.20 time: 0.323743 May 23 12:38:42.279393 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 311/619] 10.222.0.16 () {62 vars in 1318 bytes} [Mon May 23 12:38:41 2022] POST /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 23 12:38:42.286627 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0a2a0e9a-3cc1-42d0-bf94-ae826f2b61c5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:42.288261 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-77779555-0e77-4451-8d06-df2a52168c96 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:42.289376 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-77779555-0e77-4451-8d06-df2a52168c96 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:42.290879 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-0a2a0e9a-3cc1-42d0-bf94-ae826f2b61c5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:42.300884 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-77779555-0e77-4451-8d06-df2a52168c96 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:42.301656 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0a2a0e9a-3cc1-42d0-bf94-ae826f2b61c5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:42.301904 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-77779555-0e77-4451-8d06-df2a52168c96 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:42.302587 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0a2a0e9a-3cc1-42d0-bf94-ae826f2b61c5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:42.303375 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-77779555-0e77-4451-8d06-df2a52168c96 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:42.303997 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0a2a0e9a-3cc1-42d0-bf94-ae826f2b61c5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:42.304527 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0a2a0e9a-3cc1-42d0-bf94-ae826f2b61c5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:42.307343 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-77779555-0e77-4451-8d06-df2a52168c96 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:42.349399 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:38:42.422344 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-77779555-0e77-4451-8d06-df2a52168c96 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:42.437815 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-77779555-0e77-4451-8d06-df2a52168c96 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f" status: 200 len: 1621 microversion: 2.1 time: 0.155023 May 23 12:38:42.447240 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 312/620] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:38:42 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f => generated 1621 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:38:42.452685 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-e9723431-fa24-4eb0-bc38-918b29c1c01f req-37a1afce-dd8b-45df-8778-4e94cf3a8cc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64486ed1-2721-4c2a-a2fb-a96f3a82f32f", "name": "network-vif-deleted", "tag": "ccd5bdc8-a41b-4e8c-aebe-0858a605b65b"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:38:42.466319 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-e9723431-fa24-4eb0-bc38-918b29c1c01f req-37a1afce-dd8b-45df-8778-4e94cf3a8cc0 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:42.466763 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-e9723431-fa24-4eb0-bc38-918b29c1c01f req-37a1afce-dd8b-45df-8778-4e94cf3a8cc0 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:42.482013 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-e9723431-fa24-4eb0-bc38-918b29c1c01f req-37a1afce-dd8b-45df-8778-4e94cf3a8cc0 service nova] Creating event network-vif-deleted:ccd5bdc8-a41b-4e8c-aebe-0858a605b65b for instance 64486ed1-2721-4c2a-a2fb-a96f3a82f32f on hv-cinder-83699 May 23 12:38:42.487298 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-e9723431-fa24-4eb0-bc38-918b29c1c01f req-37a1afce-dd8b-45df-8778-4e94cf3a8cc0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046720 May 23 12:38:42.488593 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 313/621] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:38:42.533738 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0a2a0e9a-3cc1-42d0-bf94-ae826f2b61c5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:42.543164 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0a2a0e9a-3cc1-42d0-bf94-ae826f2b61c5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:42.546007 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0a2a0e9a-3cc1-42d0-bf94-ae826f2b61c5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:42.547235 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-0a2a0e9a-3cc1-42d0-bf94-ae826f2b61c5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.266533 May 23 12:38:42.547859 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 309/622] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:38:42 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:38:43.457332 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-e2d98868-720b-416b-ae30-fe1951d42347 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:43.457955 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-e2d98868-720b-416b-ae30-fe1951d42347 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 64486ed1-2721-4c2a-a2fb-a96f3a82f32f] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:43.464226 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e2d98868-720b-416b-ae30-fe1951d42347 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:43.464712 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e2d98868-720b-416b-ae30-fe1951d42347 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:43.466154 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e2d98868-720b-416b-ae30-fe1951d42347 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:43.466649 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e2d98868-720b-416b-ae30-fe1951d42347 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:43.479979 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.wsgi [None req-e2d98868-720b-416b-ae30-fe1951d42347 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] HTTP exception thrown: Instance 64486ed1-2721-4c2a-a2fb-a96f3a82f32f could not be found. May 23 12:38:43.481700 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-e2d98868-720b-416b-ae30-fe1951d42347 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Request method failure captured: May 23 12:38:43.481700 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: request: GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f HTTP/1.1 May 23 12:38:43.481700 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept: application/json May 23 12:38:43.481700 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept-Encoding: identity May 23 12:38:43.481700 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Connection: close May 23 12:38:43.481700 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Length: 0 May 23 12:38:43.481700 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Type: application/json May 23 12:38:43.481700 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Host: 10.222.0.16 May 23 12:38:43.481700 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Openstack-System-Scope: None May 23 12:38:43.481700 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: User-Agent: python-urllib3/1.26.9 May 23 12:38:43.481700 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Auth-Token: gAAAAABii38iJaeoogG5HQkTeh9nj0rGOP9VyOFedVQ4rI22IsjBVAneC4_uWbO22G3kbdcZRA9jPU4ejUnxmNU5jfy_2y_etQMmPY5AMnbyQR_IV7orew0xRV9LzMqa87mHc9D9zuVTwg73oa7Mf_pjol8tTgwzZ3VnGtE-MhQByJ8OewzppZw May 23 12:38:43.481700 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Id: None May 23 12:38:43.481700 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Name: None May 23 12:38:43.481700 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Identity-Status: Confirmed May 23 12:38:43.481700 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Is-Admin-Project: True May 23 12:38:43.481700 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Id: default May 23 12:38:43.481700 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Name: Default May 23 12:38:43.481700 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Id: dcc45b8bab17498cadda8d64b3a76780 May 23 12:38:43.481700 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1322715344 May 23 12:38:43.481700 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Role: member,reader May 23 12:38:43.481700 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Roles: member,reader May 23 12:38:43.483153 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dcc45b8bab17498cadda8d64b3a76780"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dcc45b8bab17498cadda8d64b3a76780"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dcc45b8bab17498cadda8d64b3a76780", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dcc45b8bab17498cadda8d64b3a76780"}]}] May 23 12:38:43.483153 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1322715344 May 23 12:38:43.483153 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Id: dcc45b8bab17498cadda8d64b3a76780 May 23 12:38:43.483153 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1322715344 May 23 12:38:43.483153 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User: tempest-ServerRescueNegativeTestJSON-1322715344-project May 23 12:38:43.483153 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Id: default May 23 12:38:43.483153 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Name: Default May 23 12:38:43.483153 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Id: 687208d733174bffa2783e6857401f39 May 23 12:38:43.483153 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1322715344-project May 23 12:38:43.483153 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: method: > May 23 12:38:43.483153 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: exception: Instance 64486ed1-2721-4c2a-a2fb-a96f3a82f32f could not be found. May 23 12:38:43.483153 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: action_args: {'id': '64486ed1-2721-4c2a-a2fb-a96f3a82f32f'} May 23 12:38:43.484160 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:38:43.484160 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:38:43.484160 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:38:43.484160 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:38:43.484160 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:38:43.484160 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:38:43.484160 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:38:43.484160 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:38:43.484160 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:38:43.484160 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:38:43.484160 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64486ed1-2721-4c2a-a2fb-a96f3a82f32f could not be found. May 23 12:38:43.484160 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:38:43.484160 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:38:43.484160 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:38:43.484160 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:38:43.484160 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:38:43.484160 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:38:43.484160 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:38:43.484160 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:38:43.484160 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:38:43.485736 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:38:43.485736 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:38:43.485736 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:38:43.485736 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:38:43.485736 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:38:43.485736 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:38:43.485736 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:38:43.485736 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64486ed1-2721-4c2a-a2fb-a96f3a82f32f could not be found. May 23 12:38:43.485736 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:38:43.485736 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:38:43.485736 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:38:43.485736 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:38:43.485736 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:38:43.485736 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:38:43.485736 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:38:43.485736 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:38:43.485736 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64486ed1-2721-4c2a-a2fb-a96f3a82f32f could not be found. May 23 12:38:43.485736 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:38:43.487326 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-e2d98868-720b-416b-ae30-fe1951d42347 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Returning 404 to user: Instance 64486ed1-2721-4c2a-a2fb-a96f3a82f32f could not be found. {{(pid=124200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:38:43.487326 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-e2d98868-720b-416b-ae30-fe1951d42347 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f" status: 404 len: 111 microversion: 2.1 time: 0.030996 May 23 12:38:43.487326 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 314/623] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:38:43 2022] GET /compute/v2.1/servers/64486ed1-2721-4c2a-a2fb-a96f3a82f32f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:38:43.491786 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0dafe6ed-fbbb-4fdd-bc01-d8515c27c9ca tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '.version_select at 0x7f095d0fdaf0>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:43.510659 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-0dafe6ed-fbbb-4fdd-bc01-d8515c27c9ca tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-25587323" status: 202 len: 0 microversion: 2.1 time: 0.022607 May 23 12:38:43.511230 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 310/624] 10.222.0.16 () {58 vars in 1214 bytes} [Mon May 23 12:38:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-25587323 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:38:43.566968 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-1138c7d7-0478-4829-a2a7-4ec36c971f50 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:43.567884 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-1138c7d7-0478-4829-a2a7-4ec36c971f50 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:43.575063 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1138c7d7-0478-4829-a2a7-4ec36c971f50 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:43.575616 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1138c7d7-0478-4829-a2a7-4ec36c971f50 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:43.576635 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1138c7d7-0478-4829-a2a7-4ec36c971f50 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:43.577027 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1138c7d7-0478-4829-a2a7-4ec36c971f50 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:43.751613 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-1138c7d7-0478-4829-a2a7-4ec36c971f50 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:43.760657 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-1138c7d7-0478-4829-a2a7-4ec36c971f50 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:43.762454 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-1138c7d7-0478-4829-a2a7-4ec36c971f50 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:43.763827 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-1138c7d7-0478-4829-a2a7-4ec36c971f50 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.200929 May 23 12:38:43.764573 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 315/625] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:38:43 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:38:44.783896 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-de9403d7-df5b-441e-a7a1-e53320b3d258 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:44.784470 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-de9403d7-df5b-441e-a7a1-e53320b3d258 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:44.792479 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-de9403d7-df5b-441e-a7a1-e53320b3d258 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:44.792924 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-de9403d7-df5b-441e-a7a1-e53320b3d258 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:44.794378 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-de9403d7-df5b-441e-a7a1-e53320b3d258 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:44.794810 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-de9403d7-df5b-441e-a7a1-e53320b3d258 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:44.925313 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-de9403d7-df5b-441e-a7a1-e53320b3d258 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:44.933278 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-de9403d7-df5b-441e-a7a1-e53320b3d258 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:44.934857 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-de9403d7-df5b-441e-a7a1-e53320b3d258 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:44.936013 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-de9403d7-df5b-441e-a7a1-e53320b3d258 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.156602 May 23 12:38:44.936598 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 311/626] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:38:44 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:38:45.955161 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-54ad5805-1872-47b3-99f3-d17d5b189c8d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:45.955772 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-54ad5805-1872-47b3-99f3-d17d5b189c8d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:45.962298 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-54ad5805-1872-47b3-99f3-d17d5b189c8d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:45.962743 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-54ad5805-1872-47b3-99f3-d17d5b189c8d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:45.963501 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-54ad5805-1872-47b3-99f3-d17d5b189c8d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:45.963950 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-54ad5805-1872-47b3-99f3-d17d5b189c8d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:46.097730 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-54ad5805-1872-47b3-99f3-d17d5b189c8d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:46.105674 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-54ad5805-1872-47b3-99f3-d17d5b189c8d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:46.108232 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-54ad5805-1872-47b3-99f3-d17d5b189c8d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:46.109374 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-54ad5805-1872-47b3-99f3-d17d5b189c8d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.158478 May 23 12:38:46.109918 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 316/627] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:38:45 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:38:46.434693 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-bf10e532-9c27-4f41-ad5b-20e5dd06d8b1 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:46.435220 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-bf10e532-9c27-4f41-ad5b-20e5dd06d8b1 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:46.441690 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bf10e532-9c27-4f41-ad5b-20e5dd06d8b1 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:46.442142 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bf10e532-9c27-4f41-ad5b-20e5dd06d8b1 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:46.442941 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bf10e532-9c27-4f41-ad5b-20e5dd06d8b1 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:46.443379 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bf10e532-9c27-4f41-ad5b-20e5dd06d8b1 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:46.469299 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-bf10e532-9c27-4f41-ad5b-20e5dd06d8b1 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Going to try to terminate instance {{(pid=124199) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 12:38:46.546104 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-bf10e532-9c27-4f41-ad5b-20e5dd06d8b1 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 204 len: 0 microversion: 2.1 time: 0.114811 May 23 12:38:46.547287 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 312/628] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 12:38:46 2022] DELETE /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 12:38:46.555208 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-f3ebe21e-9304-4c52-b1d2-8697fe54352b tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:46.555810 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-f3ebe21e-9304-4c52-b1d2-8697fe54352b tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:46.562329 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f3ebe21e-9304-4c52-b1d2-8697fe54352b tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:46.562754 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f3ebe21e-9304-4c52-b1d2-8697fe54352b tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:46.563511 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f3ebe21e-9304-4c52-b1d2-8697fe54352b tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:46.563977 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f3ebe21e-9304-4c52-b1d2-8697fe54352b tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:46.691788 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-f3ebe21e-9304-4c52-b1d2-8697fe54352b tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:46.699235 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-f3ebe21e-9304-4c52-b1d2-8697fe54352b tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1507 microversion: 2.1 time: 0.147885 May 23 12:38:46.700554 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 317/629] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:38:46 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:38:47.127921 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-30f18afe-fede-48e1-ac7f-f5246d996a73 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:47.128644 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-30f18afe-fede-48e1-ac7f-f5246d996a73 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:47.134660 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-30f18afe-fede-48e1-ac7f-f5246d996a73 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:47.135105 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-30f18afe-fede-48e1-ac7f-f5246d996a73 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:47.135858 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-30f18afe-fede-48e1-ac7f-f5246d996a73 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:47.136316 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-30f18afe-fede-48e1-ac7f-f5246d996a73 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:47.265781 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-30f18afe-fede-48e1-ac7f-f5246d996a73 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:47.273739 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-30f18afe-fede-48e1-ac7f-f5246d996a73 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:47.275242 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-30f18afe-fede-48e1-ac7f-f5246d996a73 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:47.276424 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-30f18afe-fede-48e1-ac7f-f5246d996a73 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.152763 May 23 12:38:47.277012 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 313/630] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:38:47 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:38:47.717585 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-67afaaf5-0ce7-4919-b062-50b36bcd298e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:47.718196 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-67afaaf5-0ce7-4919-b062-50b36bcd298e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:47.724833 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-67afaaf5-0ce7-4919-b062-50b36bcd298e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:47.725291 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-67afaaf5-0ce7-4919-b062-50b36bcd298e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:47.726072 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-67afaaf5-0ce7-4919-b062-50b36bcd298e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:47.726518 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-67afaaf5-0ce7-4919-b062-50b36bcd298e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:47.863838 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-67afaaf5-0ce7-4919-b062-50b36bcd298e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:47.871321 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-67afaaf5-0ce7-4919-b062-50b36bcd298e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1507 microversion: 2.1 time: 0.158408 May 23 12:38:47.872010 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 318/631] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:38:47 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:38:48.294029 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-40973ebf-cb32-49b0-b38e-280bbdfa92b9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:48.294770 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-40973ebf-cb32-49b0-b38e-280bbdfa92b9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:48.301059 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-40973ebf-cb32-49b0-b38e-280bbdfa92b9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:48.301507 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-40973ebf-cb32-49b0-b38e-280bbdfa92b9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:48.302265 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-40973ebf-cb32-49b0-b38e-280bbdfa92b9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:48.302698 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-40973ebf-cb32-49b0-b38e-280bbdfa92b9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:48.439589 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-40973ebf-cb32-49b0-b38e-280bbdfa92b9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:48.447422 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-40973ebf-cb32-49b0-b38e-280bbdfa92b9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:48.449020 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-40973ebf-cb32-49b0-b38e-280bbdfa92b9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:48.450160 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-40973ebf-cb32-49b0-b38e-280bbdfa92b9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.160180 May 23 12:38:48.451358 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 314/632] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:38:48 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:38:48.888527 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-2af9320e-3e9f-4999-816c-9cb109ee2c73 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:48.889198 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-2af9320e-3e9f-4999-816c-9cb109ee2c73 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:48.896056 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2af9320e-3e9f-4999-816c-9cb109ee2c73 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:48.896544 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2af9320e-3e9f-4999-816c-9cb109ee2c73 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:48.897319 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2af9320e-3e9f-4999-816c-9cb109ee2c73 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:48.897757 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2af9320e-3e9f-4999-816c-9cb109ee2c73 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:49.035822 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-2af9320e-3e9f-4999-816c-9cb109ee2c73 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:49.043939 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-2af9320e-3e9f-4999-816c-9cb109ee2c73 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1507 microversion: 2.1 time: 0.159783 May 23 12:38:49.045217 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 319/633] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:38:48 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:38:49.470191 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b3c21d75-92c6-40ae-8da1-3ae937817d54 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:49.470850 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-b3c21d75-92c6-40ae-8da1-3ae937817d54 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:49.477382 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b3c21d75-92c6-40ae-8da1-3ae937817d54 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:49.477854 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b3c21d75-92c6-40ae-8da1-3ae937817d54 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:49.478626 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b3c21d75-92c6-40ae-8da1-3ae937817d54 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:49.479069 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b3c21d75-92c6-40ae-8da1-3ae937817d54 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:49.645500 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b3c21d75-92c6-40ae-8da1-3ae937817d54 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:49.657252 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b3c21d75-92c6-40ae-8da1-3ae937817d54 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:49.659606 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b3c21d75-92c6-40ae-8da1-3ae937817d54 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:49.660830 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b3c21d75-92c6-40ae-8da1-3ae937817d54 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.195462 May 23 12:38:49.663264 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 315/634] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:38:49 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:38:49.678729 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-3dd01f2a-40a3-492f-9a7b-b5413c81d903 req-6324d2b8-996e-4d5d-9d68-b3acd09b1a61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6862b746-8558-4cd5-b71a-9a69ad923901", "name": "network-vif-deleted", "tag": "c4590a1b-944a-40a6-ae11-0a586abe29b8"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:38:49.688531 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-3dd01f2a-40a3-492f-9a7b-b5413c81d903 req-6324d2b8-996e-4d5d-9d68-b3acd09b1a61 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:49.688979 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-3dd01f2a-40a3-492f-9a7b-b5413c81d903 req-6324d2b8-996e-4d5d-9d68-b3acd09b1a61 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:49.700122 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-3dd01f2a-40a3-492f-9a7b-b5413c81d903 req-6324d2b8-996e-4d5d-9d68-b3acd09b1a61 service nova] Creating event network-vif-deleted:c4590a1b-944a-40a6-ae11-0a586abe29b8 for instance 6862b746-8558-4cd5-b71a-9a69ad923901 on hv-cinder-83699 May 23 12:38:49.705838 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-3dd01f2a-40a3-492f-9a7b-b5413c81d903 req-6324d2b8-996e-4d5d-9d68-b3acd09b1a61 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105363 May 23 12:38:49.706530 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 320/635] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:38:50.062065 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-3f45a500-881a-4932-9f86-3f79bd10e8e1 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:50.062718 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-3f45a500-881a-4932-9f86-3f79bd10e8e1 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:50.068864 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3f45a500-881a-4932-9f86-3f79bd10e8e1 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:50.069323 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3f45a500-881a-4932-9f86-3f79bd10e8e1 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:50.070098 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3f45a500-881a-4932-9f86-3f79bd10e8e1 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:50.070539 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3f45a500-881a-4932-9f86-3f79bd10e8e1 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:50.105029 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3f45a500-881a-4932-9f86-3f79bd10e8e1 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:50.105513 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3f45a500-881a-4932-9f86-3f79bd10e8e1 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:50.105936 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.objects.instance [None req-3f45a500-881a-4932-9f86-3f79bd10e8e1 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lazy-loading 'fault' on Instance uuid 6862b746-8558-4cd5-b71a-9a69ad923901 {{(pid=124199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:38:50.156725 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-3f45a500-881a-4932-9f86-3f79bd10e8e1 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:50.163760 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-3f45a500-881a-4932-9f86-3f79bd10e8e1 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 200 len: 1311 microversion: 2.1 time: 0.105855 May 23 12:38:50.164347 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 316/636] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:38:50 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 1311 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:38:50.683708 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-71f64488-6174-46e8-b252-44e13cd19c39 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:50.684356 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-71f64488-6174-46e8-b252-44e13cd19c39 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:50.691218 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-71f64488-6174-46e8-b252-44e13cd19c39 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:50.691669 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-71f64488-6174-46e8-b252-44e13cd19c39 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:50.692499 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-71f64488-6174-46e8-b252-44e13cd19c39 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:50.692921 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-71f64488-6174-46e8-b252-44e13cd19c39 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:50.825589 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-71f64488-6174-46e8-b252-44e13cd19c39 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:50.833925 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-71f64488-6174-46e8-b252-44e13cd19c39 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:50.835414 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-71f64488-6174-46e8-b252-44e13cd19c39 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:50.836630 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-71f64488-6174-46e8-b252-44e13cd19c39 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.157794 May 23 12:38:50.837179 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 321/637] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:38:50 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:38:51.181358 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-93591334-b7c2-406e-8e0f-dc11a889cee5 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:51.181965 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-93591334-b7c2-406e-8e0f-dc11a889cee5 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 6862b746-8558-4cd5-b71a-9a69ad923901] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:51.189368 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-93591334-b7c2-406e-8e0f-dc11a889cee5 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:51.189821 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-93591334-b7c2-406e-8e0f-dc11a889cee5 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:51.190640 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-93591334-b7c2-406e-8e0f-dc11a889cee5 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:51.191077 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-93591334-b7c2-406e-8e0f-dc11a889cee5 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:51.205079 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.wsgi [None req-93591334-b7c2-406e-8e0f-dc11a889cee5 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] HTTP exception thrown: Instance 6862b746-8558-4cd5-b71a-9a69ad923901 could not be found. May 23 12:38:51.206694 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-93591334-b7c2-406e-8e0f-dc11a889cee5 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Request method failure captured: May 23 12:38:51.206694 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: request: GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 HTTP/1.1 May 23 12:38:51.206694 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept: application/json May 23 12:38:51.206694 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept-Encoding: identity May 23 12:38:51.206694 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Connection: close May 23 12:38:51.206694 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Length: 0 May 23 12:38:51.206694 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Type: application/json May 23 12:38:51.206694 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Host: 10.222.0.16 May 23 12:38:51.206694 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Openstack-System-Scope: None May 23 12:38:51.206694 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: User-Agent: python-urllib3/1.26.9 May 23 12:38:51.206694 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Auth-Token: gAAAAABii38iJaeoogG5HQkTeh9nj0rGOP9VyOFedVQ4rI22IsjBVAneC4_uWbO22G3kbdcZRA9jPU4ejUnxmNU5jfy_2y_etQMmPY5AMnbyQR_IV7orew0xRV9LzMqa87mHc9D9zuVTwg73oa7Mf_pjol8tTgwzZ3VnGtE-MhQByJ8OewzppZw May 23 12:38:51.206694 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Id: None May 23 12:38:51.206694 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Name: None May 23 12:38:51.206694 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Identity-Status: Confirmed May 23 12:38:51.206694 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Is-Admin-Project: True May 23 12:38:51.206694 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Id: default May 23 12:38:51.206694 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Name: Default May 23 12:38:51.206694 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Id: dcc45b8bab17498cadda8d64b3a76780 May 23 12:38:51.206694 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1322715344 May 23 12:38:51.206694 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Role: member,reader May 23 12:38:51.206694 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Roles: member,reader May 23 12:38:51.208090 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dcc45b8bab17498cadda8d64b3a76780"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dcc45b8bab17498cadda8d64b3a76780"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dcc45b8bab17498cadda8d64b3a76780", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dcc45b8bab17498cadda8d64b3a76780"}]}] May 23 12:38:51.208090 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1322715344 May 23 12:38:51.208090 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Id: dcc45b8bab17498cadda8d64b3a76780 May 23 12:38:51.208090 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1322715344 May 23 12:38:51.208090 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User: tempest-ServerRescueNegativeTestJSON-1322715344-project May 23 12:38:51.208090 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Id: default May 23 12:38:51.208090 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Name: Default May 23 12:38:51.208090 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Id: 687208d733174bffa2783e6857401f39 May 23 12:38:51.208090 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1322715344-project May 23 12:38:51.208090 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: method: > May 23 12:38:51.208090 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: exception: Instance 6862b746-8558-4cd5-b71a-9a69ad923901 could not be found. May 23 12:38:51.208090 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: action_args: {'id': '6862b746-8558-4cd5-b71a-9a69ad923901'} May 23 12:38:51.208874 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:38:51.208874 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:38:51.208874 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:38:51.208874 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:38:51.208874 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:38:51.208874 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:38:51.208874 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:38:51.208874 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:38:51.208874 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:38:51.208874 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:38:51.208874 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6862b746-8558-4cd5-b71a-9a69ad923901 could not be found. May 23 12:38:51.208874 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:38:51.208874 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:38:51.208874 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:38:51.208874 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:38:51.208874 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:38:51.208874 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:38:51.208874 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:38:51.208874 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:38:51.208874 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:38:51.210288 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:38:51.210288 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:38:51.210288 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:38:51.210288 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:38:51.210288 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:38:51.210288 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:38:51.210288 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:38:51.210288 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6862b746-8558-4cd5-b71a-9a69ad923901 could not be found. May 23 12:38:51.210288 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:38:51.210288 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:38:51.210288 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:38:51.210288 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:38:51.210288 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:38:51.210288 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:38:51.210288 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:38:51.210288 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:38:51.210288 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6862b746-8558-4cd5-b71a-9a69ad923901 could not be found. May 23 12:38:51.210288 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:38:51.211846 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-93591334-b7c2-406e-8e0f-dc11a889cee5 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Returning 404 to user: Instance 6862b746-8558-4cd5-b71a-9a69ad923901 could not be found. {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:38:51.211846 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-93591334-b7c2-406e-8e0f-dc11a889cee5 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901" status: 404 len: 111 microversion: 2.1 time: 0.030770 May 23 12:38:51.211846 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 317/638] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:38:51 2022] GET /compute/v2.1/servers/6862b746-8558-4cd5-b71a-9a69ad923901 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:38:51.217428 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-b7367849-8603-477f-b2ab-0b4033d416e7 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:51.217957 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-b7367849-8603-477f-b2ab-0b4033d416e7 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:51.224350 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b7367849-8603-477f-b2ab-0b4033d416e7 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:51.224799 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b7367849-8603-477f-b2ab-0b4033d416e7 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:51.225561 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b7367849-8603-477f-b2ab-0b4033d416e7 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:51.225993 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b7367849-8603-477f-b2ab-0b4033d416e7 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:51.251908 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-b7367849-8603-477f-b2ab-0b4033d416e7 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Going to try to terminate instance {{(pid=124200) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 12:38:51.331798 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-b7367849-8603-477f-b2ab-0b4033d416e7 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 204 len: 0 microversion: 2.1 time: 0.118743 May 23 12:38:51.332324 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 322/639] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 12:38:51 2022] DELETE /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 12:38:51.342679 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-42392f33-4b70-45af-a125-9a5035fe865d tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:51.343344 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-42392f33-4b70-45af-a125-9a5035fe865d tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:51.350616 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-42392f33-4b70-45af-a125-9a5035fe865d tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:51.351063 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-42392f33-4b70-45af-a125-9a5035fe865d tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:51.351829 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-42392f33-4b70-45af-a125-9a5035fe865d tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:51.352324 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-42392f33-4b70-45af-a125-9a5035fe865d tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:51.486496 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-42392f33-4b70-45af-a125-9a5035fe865d tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:51.494199 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-42392f33-4b70-45af-a125-9a5035fe865d tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1523 microversion: 2.1 time: 0.157371 May 23 12:38:51.494750 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 318/640] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:38:51 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:38:51.855961 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-5dc4489c-7858-4625-afde-6ab65f2d768b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:51.857250 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-5dc4489c-7858-4625-afde-6ab65f2d768b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:51.863509 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5dc4489c-7858-4625-afde-6ab65f2d768b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:51.863952 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5dc4489c-7858-4625-afde-6ab65f2d768b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:51.864748 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5dc4489c-7858-4625-afde-6ab65f2d768b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:51.865188 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5dc4489c-7858-4625-afde-6ab65f2d768b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:51.998276 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-5dc4489c-7858-4625-afde-6ab65f2d768b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:52.006190 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-5dc4489c-7858-4625-afde-6ab65f2d768b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:52.007696 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-5dc4489c-7858-4625-afde-6ab65f2d768b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:52.008879 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-5dc4489c-7858-4625-afde-6ab65f2d768b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.157199 May 23 12:38:52.009438 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 323/641] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:38:51 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:38:52.511972 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-07728f89-9ca3-4038-aa19-df8bebd93ac9 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:52.512566 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-07728f89-9ca3-4038-aa19-df8bebd93ac9 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:52.519713 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-07728f89-9ca3-4038-aa19-df8bebd93ac9 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:52.520156 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-07728f89-9ca3-4038-aa19-df8bebd93ac9 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:52.520949 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-07728f89-9ca3-4038-aa19-df8bebd93ac9 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:52.521381 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-07728f89-9ca3-4038-aa19-df8bebd93ac9 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:52.649517 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-07728f89-9ca3-4038-aa19-df8bebd93ac9 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:52.657984 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-07728f89-9ca3-4038-aa19-df8bebd93ac9 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1523 microversion: 2.1 time: 0.149892 May 23 12:38:52.658576 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 319/642] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:38:52 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:38:53.027111 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-3c856f71-e89d-40fb-9bf9-483b58623a9f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:53.027740 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-3c856f71-e89d-40fb-9bf9-483b58623a9f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:53.035196 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3c856f71-e89d-40fb-9bf9-483b58623a9f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:53.035648 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3c856f71-e89d-40fb-9bf9-483b58623a9f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:53.036448 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3c856f71-e89d-40fb-9bf9-483b58623a9f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:53.036884 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3c856f71-e89d-40fb-9bf9-483b58623a9f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:53.051534 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:38:53.171229 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-3c856f71-e89d-40fb-9bf9-483b58623a9f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:53.179226 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-3c856f71-e89d-40fb-9bf9-483b58623a9f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:53.180763 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-3c856f71-e89d-40fb-9bf9-483b58623a9f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:53.181906 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-3c856f71-e89d-40fb-9bf9-483b58623a9f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.158740 May 23 12:38:53.182465 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 324/643] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:38:53 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:38:53.675928 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-941772a6-0e1f-464d-a6ab-e59520c7dab0 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:53.676575 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-941772a6-0e1f-464d-a6ab-e59520c7dab0 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:53.682983 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-941772a6-0e1f-464d-a6ab-e59520c7dab0 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:53.683428 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-941772a6-0e1f-464d-a6ab-e59520c7dab0 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:53.684208 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-941772a6-0e1f-464d-a6ab-e59520c7dab0 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:53.684645 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-941772a6-0e1f-464d-a6ab-e59520c7dab0 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:53.814398 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-941772a6-0e1f-464d-a6ab-e59520c7dab0 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:53.821788 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-941772a6-0e1f-464d-a6ab-e59520c7dab0 tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1523 microversion: 2.1 time: 0.149674 May 23 12:38:53.822351 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 320/644] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:38:53 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:38:54.201526 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-608f85b9-06c0-48ff-87f2-0b1d95e37762 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:54.202381 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-608f85b9-06c0-48ff-87f2-0b1d95e37762 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:54.208859 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-608f85b9-06c0-48ff-87f2-0b1d95e37762 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:54.209301 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-608f85b9-06c0-48ff-87f2-0b1d95e37762 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:54.210077 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-608f85b9-06c0-48ff-87f2-0b1d95e37762 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:54.210489 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-608f85b9-06c0-48ff-87f2-0b1d95e37762 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:54.343890 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-608f85b9-06c0-48ff-87f2-0b1d95e37762 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:54.352441 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-608f85b9-06c0-48ff-87f2-0b1d95e37762 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:54.353941 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-608f85b9-06c0-48ff-87f2-0b1d95e37762 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:54.355137 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-608f85b9-06c0-48ff-87f2-0b1d95e37762 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.158120 May 23 12:38:54.355693 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 325/645] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:38:54 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:38:54.840590 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-8b92babc-ed37-43f3-9d51-6c1c76cc26cf tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:54.841417 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-8b92babc-ed37-43f3-9d51-6c1c76cc26cf tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:54.848727 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8b92babc-ed37-43f3-9d51-6c1c76cc26cf tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:54.849183 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8b92babc-ed37-43f3-9d51-6c1c76cc26cf tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:54.849971 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8b92babc-ed37-43f3-9d51-6c1c76cc26cf tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:54.850407 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8b92babc-ed37-43f3-9d51-6c1c76cc26cf tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:54.994049 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-8b92babc-ed37-43f3-9d51-6c1c76cc26cf tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687208d733174bffa2783e6857401f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc45b8bab17498cadda8d64b3a76780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:55.002707 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-8b92babc-ed37-43f3-9d51-6c1c76cc26cf tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 200 len: 1523 microversion: 2.1 time: 0.166671 May 23 12:38:55.003240 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 321/646] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:38:54 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:38:55.086146 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-b95e61c4-5d82-44e9-a5ff-72e940e0fe63 req-791405e2-ed4e-411e-b0c1-aa3c9efaf804 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cdb78f1-4de7-4c61-82e0-abe6c742e7aa", "name": "network-vif-deleted", "tag": "47e7dcef-9f40-451c-adfd-004f425d19fb"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:38:55.099234 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-b95e61c4-5d82-44e9-a5ff-72e940e0fe63 req-791405e2-ed4e-411e-b0c1-aa3c9efaf804 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:55.099769 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-b95e61c4-5d82-44e9-a5ff-72e940e0fe63 req-791405e2-ed4e-411e-b0c1-aa3c9efaf804 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:55.112720 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-b95e61c4-5d82-44e9-a5ff-72e940e0fe63 req-791405e2-ed4e-411e-b0c1-aa3c9efaf804 service nova] Creating event network-vif-deleted:47e7dcef-9f40-451c-adfd-004f425d19fb for instance 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa on hv-cinder-83699 May 23 12:38:55.117441 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-b95e61c4-5d82-44e9-a5ff-72e940e0fe63 req-791405e2-ed4e-411e-b0c1-aa3c9efaf804 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035074 May 23 12:38:55.118031 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 326/647] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:38:55.373637 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-55979c77-0c45-4a79-957a-b87aef652506 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:55.374316 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-55979c77-0c45-4a79-957a-b87aef652506 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:55.380817 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-55979c77-0c45-4a79-957a-b87aef652506 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:55.381261 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-55979c77-0c45-4a79-957a-b87aef652506 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:55.382048 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-55979c77-0c45-4a79-957a-b87aef652506 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:55.382489 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-55979c77-0c45-4a79-957a-b87aef652506 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:55.525795 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-55979c77-0c45-4a79-957a-b87aef652506 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:55.535617 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-55979c77-0c45-4a79-957a-b87aef652506 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:55.537207 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-55979c77-0c45-4a79-957a-b87aef652506 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:55.538421 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-55979c77-0c45-4a79-957a-b87aef652506 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.168912 May 23 12:38:55.539173 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 322/648] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:38:55 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:38:56.020250 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-8670caff-ec57-4f82-bfaf-9c640a960b5e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:56.020950 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-8670caff-ec57-4f82-bfaf-9c640a960b5e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] [instance: 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:56.027594 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8670caff-ec57-4f82-bfaf-9c640a960b5e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:56.028040 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8670caff-ec57-4f82-bfaf-9c640a960b5e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:56.028945 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8670caff-ec57-4f82-bfaf-9c640a960b5e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:56.030026 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8670caff-ec57-4f82-bfaf-9c640a960b5e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:56.043755 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.wsgi [None req-8670caff-ec57-4f82-bfaf-9c640a960b5e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] HTTP exception thrown: Instance 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa could not be found. May 23 12:38:56.046400 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-8670caff-ec57-4f82-bfaf-9c640a960b5e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Request method failure captured: May 23 12:38:56.046400 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: request: GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa HTTP/1.1 May 23 12:38:56.046400 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept: application/json May 23 12:38:56.046400 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept-Encoding: identity May 23 12:38:56.046400 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Connection: close May 23 12:38:56.046400 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Length: 0 May 23 12:38:56.046400 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Type: application/json May 23 12:38:56.046400 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Host: 10.222.0.16 May 23 12:38:56.046400 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Openstack-System-Scope: None May 23 12:38:56.046400 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: User-Agent: python-urllib3/1.26.9 May 23 12:38:56.046400 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Auth-Token: gAAAAABii38iJaeoogG5HQkTeh9nj0rGOP9VyOFedVQ4rI22IsjBVAneC4_uWbO22G3kbdcZRA9jPU4ejUnxmNU5jfy_2y_etQMmPY5AMnbyQR_IV7orew0xRV9LzMqa87mHc9D9zuVTwg73oa7Mf_pjol8tTgwzZ3VnGtE-MhQByJ8OewzppZw May 23 12:38:56.046400 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Id: None May 23 12:38:56.046400 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Name: None May 23 12:38:56.046400 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Identity-Status: Confirmed May 23 12:38:56.046400 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Is-Admin-Project: True May 23 12:38:56.046400 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Id: default May 23 12:38:56.046400 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Name: Default May 23 12:38:56.046400 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Id: dcc45b8bab17498cadda8d64b3a76780 May 23 12:38:56.046400 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1322715344 May 23 12:38:56.046400 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Role: member,reader May 23 12:38:56.046400 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Roles: member,reader May 23 12:38:56.048616 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dcc45b8bab17498cadda8d64b3a76780"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dcc45b8bab17498cadda8d64b3a76780"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dcc45b8bab17498cadda8d64b3a76780", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dcc45b8bab17498cadda8d64b3a76780"}]}] May 23 12:38:56.048616 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1322715344 May 23 12:38:56.048616 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Id: dcc45b8bab17498cadda8d64b3a76780 May 23 12:38:56.048616 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1322715344 May 23 12:38:56.048616 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User: tempest-ServerRescueNegativeTestJSON-1322715344-project May 23 12:38:56.048616 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Id: default May 23 12:38:56.048616 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Name: Default May 23 12:38:56.048616 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Id: 687208d733174bffa2783e6857401f39 May 23 12:38:56.048616 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1322715344-project May 23 12:38:56.048616 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: method: > May 23 12:38:56.048616 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: exception: Instance 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa could not be found. May 23 12:38:56.048616 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: action_args: {'id': '9cdb78f1-4de7-4c61-82e0-abe6c742e7aa'} May 23 12:38:56.049484 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:38:56.049484 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:38:56.049484 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:38:56.049484 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:38:56.049484 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:38:56.049484 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:38:56.049484 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:38:56.049484 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:38:56.049484 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:38:56.049484 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:38:56.049484 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa could not be found. May 23 12:38:56.049484 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:38:56.049484 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:38:56.049484 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:38:56.049484 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:38:56.049484 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:38:56.049484 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:38:56.049484 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:38:56.049484 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:38:56.049484 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:38:56.050881 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:38:56.050881 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:38:56.050881 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:38:56.050881 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:38:56.050881 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:38:56.050881 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:38:56.050881 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:38:56.050881 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa could not be found. May 23 12:38:56.050881 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:38:56.050881 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:38:56.050881 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:38:56.050881 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:38:56.050881 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:38:56.050881 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:38:56.050881 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:38:56.050881 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:38:56.050881 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa could not be found. May 23 12:38:56.050881 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:38:56.051957 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-8670caff-ec57-4f82-bfaf-9c640a960b5e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] Returning 404 to user: Instance 9cdb78f1-4de7-4c61-82e0-abe6c742e7aa could not be found. {{(pid=124200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:38:56.051957 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-8670caff-ec57-4f82-bfaf-9c640a960b5e tempest-ServerRescueNegativeTestJSON-1322715344 tempest-ServerRescueNegativeTestJSON-1322715344-project] 10.222.0.16 "GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa" status: 404 len: 111 microversion: 2.1 time: 0.032470 May 23 12:38:56.051957 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 327/649] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:38:56 2022] GET /compute/v2.1/servers/9cdb78f1-4de7-4c61-82e0-abe6c742e7aa => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:38:56.556526 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-8eb76d49-1eae-4993-888b-81761780e0ef tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:56.557312 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-8eb76d49-1eae-4993-888b-81761780e0ef tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:56.564581 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8eb76d49-1eae-4993-888b-81761780e0ef tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:56.565029 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8eb76d49-1eae-4993-888b-81761780e0ef tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:56.565938 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8eb76d49-1eae-4993-888b-81761780e0ef tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:56.566387 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8eb76d49-1eae-4993-888b-81761780e0ef tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:56.843236 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-8eb76d49-1eae-4993-888b-81761780e0ef tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:56.851675 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-8eb76d49-1eae-4993-888b-81761780e0ef tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:56.853259 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-8eb76d49-1eae-4993-888b-81761780e0ef tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:56.854460 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-8eb76d49-1eae-4993-888b-81761780e0ef tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.301972 May 23 12:38:56.855037 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 323/650] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:38:56 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:38:57.873332 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-f840e6fc-9426-4089-a2bd-71fbe2c85a94 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:57.874043 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-f840e6fc-9426-4089-a2bd-71fbe2c85a94 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:57.880725 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f840e6fc-9426-4089-a2bd-71fbe2c85a94 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:57.881202 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f840e6fc-9426-4089-a2bd-71fbe2c85a94 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:57.882114 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f840e6fc-9426-4089-a2bd-71fbe2c85a94 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:57.883244 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f840e6fc-9426-4089-a2bd-71fbe2c85a94 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:58.143862 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-f840e6fc-9426-4089-a2bd-71fbe2c85a94 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:58.152646 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-f840e6fc-9426-4089-a2bd-71fbe2c85a94 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:58.154575 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-f840e6fc-9426-4089-a2bd-71fbe2c85a94 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:58.155756 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-f840e6fc-9426-4089-a2bd-71fbe2c85a94 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.286544 May 23 12:38:58.157245 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 328/651] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:38:57 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:38:59.174881 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-8f71913a-5eb4-4e1d-a187-be06858aa9f7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:59.175425 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-8f71913a-5eb4-4e1d-a187-be06858aa9f7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:59.182621 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8f71913a-5eb4-4e1d-a187-be06858aa9f7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:59.183082 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8f71913a-5eb4-4e1d-a187-be06858aa9f7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:59.183857 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8f71913a-5eb4-4e1d-a187-be06858aa9f7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:59.184400 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8f71913a-5eb4-4e1d-a187-be06858aa9f7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:59.397787 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-8f71913a-5eb4-4e1d-a187-be06858aa9f7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:59.411021 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-8f71913a-5eb4-4e1d-a187-be06858aa9f7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:59.412727 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-8f71913a-5eb4-4e1d-a187-be06858aa9f7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:59.414129 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-8f71913a-5eb4-4e1d-a187-be06858aa9f7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.243416 May 23 12:38:59.414705 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 324/652] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:38:59 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:38:59.548726 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-2b8a1c24-5fa8-490f-98c2-8e73b34dac33 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:38:59.549331 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-2b8a1c24-5fa8-490f-98c2-8e73b34dac33 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:59.556022 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2b8a1c24-5fa8-490f-98c2-8e73b34dac33 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:59.556555 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2b8a1c24-5fa8-490f-98c2-8e73b34dac33 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:59.557332 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2b8a1c24-5fa8-490f-98c2-8e73b34dac33 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:59.557769 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2b8a1c24-5fa8-490f-98c2-8e73b34dac33 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:59.592692 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.objects.instance [None req-2b8a1c24-5fa8-490f-98c2-8e73b34dac33 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lazy-loading 'flavor' on Instance uuid 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed {{(pid=124200) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:38:59.680987 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-2b8a1c24-5fa8-490f-98c2-8e73b34dac33 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "POST /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed/action" status: 202 len: 0 microversion: 2.1 time: 0.136863 May 23 12:38:59.681895 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 329/653] 10.222.0.16 () {60 vars in 1277 bytes} [Mon May 23 12:38:59 2022] POST /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:38:59.690502 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-1500aadb-1973-471d-b9d0-cf87b1983568 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:59.691141 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-1500aadb-1973-471d-b9d0-cf87b1983568 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:38:59.698961 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1500aadb-1973-471d-b9d0-cf87b1983568 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:59.699382 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1500aadb-1973-471d-b9d0-cf87b1983568 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:59.700226 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1500aadb-1973-471d-b9d0-cf87b1983568 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:59.700693 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1500aadb-1973-471d-b9d0-cf87b1983568 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:59.962851 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1500aadb-1973-471d-b9d0-cf87b1983568 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:38:59.966375 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:38:59.974422 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-1500aadb-1973-471d-b9d0-cf87b1983568 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1568 microversion: 2.1 time: 0.288050 May 23 12:38:59.974942 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 325/654] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:38:59 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1568 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:39:00.434926 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-4127e6d1-ad9f-4679-becb-caede77fe5c0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:00.436279 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-4127e6d1-ad9f-4679-becb-caede77fe5c0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:00.443451 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4127e6d1-ad9f-4679-becb-caede77fe5c0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:00.444084 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4127e6d1-ad9f-4679-becb-caede77fe5c0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:00.444897 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4127e6d1-ad9f-4679-becb-caede77fe5c0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:00.445330 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4127e6d1-ad9f-4679-becb-caede77fe5c0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:00.596205 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-4127e6d1-ad9f-4679-becb-caede77fe5c0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:00.604553 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-4127e6d1-ad9f-4679-becb-caede77fe5c0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:00.606073 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-4127e6d1-ad9f-4679-becb-caede77fe5c0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:00.608419 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-4127e6d1-ad9f-4679-becb-caede77fe5c0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.177579 May 23 12:39:00.609266 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 330/655] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:39:00 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:39:00.993081 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-386fcb81-f9aa-415b-af0b-8f12d4ebaf5d tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:00.993706 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-386fcb81-f9aa-415b-af0b-8f12d4ebaf5d tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:01.001401 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-386fcb81-f9aa-415b-af0b-8f12d4ebaf5d tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:01.001851 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-386fcb81-f9aa-415b-af0b-8f12d4ebaf5d tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:01.002796 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-386fcb81-f9aa-415b-af0b-8f12d4ebaf5d tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:01.003234 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-386fcb81-f9aa-415b-af0b-8f12d4ebaf5d tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:01.158795 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-386fcb81-f9aa-415b-af0b-8f12d4ebaf5d tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:01.167284 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-386fcb81-f9aa-415b-af0b-8f12d4ebaf5d tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1568 microversion: 2.1 time: 0.178101 May 23 12:39:01.167857 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 326/656] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:00 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:39:01.418721 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-d10bb263-8ccc-4d9b-951f-326912f1a4f7 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:01.419258 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-d10bb263-8ccc-4d9b-951f-326912f1a4f7 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 9a267457-7f06-4312-87ce-2c47cdb2924d] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:01.425887 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d10bb263-8ccc-4d9b-951f-326912f1a4f7 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:01.426341 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d10bb263-8ccc-4d9b-951f-326912f1a4f7 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:01.427119 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d10bb263-8ccc-4d9b-951f-326912f1a4f7 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:01.428304 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d10bb263-8ccc-4d9b-951f-326912f1a4f7 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:01.451756 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-d10bb263-8ccc-4d9b-951f-326912f1a4f7 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d/ips" status: 200 len: 145 microversion: 2.1 time: 0.208695 May 23 12:39:01.452305 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 331/657] 10.222.0.16 () {58 vars in 1247 bytes} [Mon May 23 12:39:01 2022] GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d/ips => generated 145 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:39:01.631302 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-a7b45633-7538-4142-88cf-3f54d13b3bbc tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:01.633002 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-a7b45633-7538-4142-88cf-3f54d13b3bbc tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:01.641476 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a7b45633-7538-4142-88cf-3f54d13b3bbc tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:01.641921 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a7b45633-7538-4142-88cf-3f54d13b3bbc tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:01.642917 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a7b45633-7538-4142-88cf-3f54d13b3bbc tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:01.643516 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a7b45633-7538-4142-88cf-3f54d13b3bbc tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:01.812112 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-a7b45633-7538-4142-88cf-3f54d13b3bbc tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:01.820063 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-a7b45633-7538-4142-88cf-3f54d13b3bbc tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:01.821624 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-a7b45633-7538-4142-88cf-3f54d13b3bbc tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:01.822792 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-a7b45633-7538-4142-88cf-3f54d13b3bbc tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.198262 May 23 12:39:01.823349 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 327/658] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:39:01 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:39:02.184576 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-0489fd0d-3a94-4363-83ff-faf30225fb39 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:02.185713 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-0489fd0d-3a94-4363-83ff-faf30225fb39 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:02.193028 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0489fd0d-3a94-4363-83ff-faf30225fb39 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:02.193486 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0489fd0d-3a94-4363-83ff-faf30225fb39 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:02.194299 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0489fd0d-3a94-4363-83ff-faf30225fb39 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:02.194841 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0489fd0d-3a94-4363-83ff-faf30225fb39 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:02.325630 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-0489fd0d-3a94-4363-83ff-faf30225fb39 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:02.334150 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-0489fd0d-3a94-4363-83ff-faf30225fb39 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1568 microversion: 2.1 time: 0.153393 May 23 12:39:02.334715 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 332/659] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:02 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:39:02.813660 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-ec178ca5-ffbb-4324-a6ce-b958f19ed4a2 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca6b14ed-ab0f-48f7-bcca-5f5b7a27f0ab"}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:39:02.814817 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-ec178ca5-ffbb-4324-a6ce-b958f19ed4a2 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 9a267457-7f06-4312-87ce-2c47cdb2924d] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:02.821259 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ec178ca5-ffbb-4324-a6ce-b958f19ed4a2 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:02.821707 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ec178ca5-ffbb-4324-a6ce-b958f19ed4a2 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:02.822463 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ec178ca5-ffbb-4324-a6ce-b958f19ed4a2 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:02.822899 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ec178ca5-ffbb-4324-a6ce-b958f19ed4a2 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:02.842139 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-a5becba4-c3f0-47b6-9424-5cc5008ba973 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:02.842867 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-a5becba4-c3f0-47b6-9424-5cc5008ba973 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:02.848988 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a5becba4-c3f0-47b6-9424-5cc5008ba973 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:02.849439 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a5becba4-c3f0-47b6-9424-5cc5008ba973 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:02.850197 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a5becba4-c3f0-47b6-9424-5cc5008ba973 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:02.850627 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a5becba4-c3f0-47b6-9424-5cc5008ba973 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:02.988111 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-a5becba4-c3f0-47b6-9424-5cc5008ba973 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:02.996400 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-a5becba4-c3f0-47b6-9424-5cc5008ba973 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:02.998377 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-a5becba4-c3f0-47b6-9424-5cc5008ba973 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:02.999373 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-a5becba4-c3f0-47b6-9424-5cc5008ba973 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.161153 May 23 12:39:02.999995 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 333/660] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:39:02 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:39:03.070056 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-ec178ca5-ffbb-4324-a6ce-b958f19ed4a2 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "POST /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260904 May 23 12:39:03.070773 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 328/661] 10.222.0.16 () {60 vars in 1322 bytes} [Mon May 23 12:39:02 2022] POST /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:39:03.351565 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-23c01fde-5977-4bda-8c27-62598bebb571 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:03.352199 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-23c01fde-5977-4bda-8c27-62598bebb571 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:03.359403 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-23c01fde-5977-4bda-8c27-62598bebb571 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:03.359842 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-23c01fde-5977-4bda-8c27-62598bebb571 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:03.360659 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-23c01fde-5977-4bda-8c27-62598bebb571 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:03.361088 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-23c01fde-5977-4bda-8c27-62598bebb571 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:03.500793 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-23c01fde-5977-4bda-8c27-62598bebb571 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:03.509434 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-23c01fde-5977-4bda-8c27-62598bebb571 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1568 microversion: 2.1 time: 0.162132 May 23 12:39:03.510003 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 334/662] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:03 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:39:04.020054 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d6d4b3af-d81f-44d5-b68c-2b04005ba683 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:04.020876 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d6d4b3af-d81f-44d5-b68c-2b04005ba683 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:04.030311 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d6d4b3af-d81f-44d5-b68c-2b04005ba683 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:04.030433 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d6d4b3af-d81f-44d5-b68c-2b04005ba683 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:04.031193 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d6d4b3af-d81f-44d5-b68c-2b04005ba683 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:04.031646 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d6d4b3af-d81f-44d5-b68c-2b04005ba683 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:04.166866 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d6d4b3af-d81f-44d5-b68c-2b04005ba683 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:04.175970 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d6d4b3af-d81f-44d5-b68c-2b04005ba683 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:04.177609 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d6d4b3af-d81f-44d5-b68c-2b04005ba683 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:04.178880 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d6d4b3af-d81f-44d5-b68c-2b04005ba683 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.165678 May 23 12:39:04.179580 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 329/663] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:39:04 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:39:04.527974 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-f7fd57f0-c0c6-4a05-8340-6bddafbc267f tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:04.528650 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-f7fd57f0-c0c6-4a05-8340-6bddafbc267f tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:04.535812 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f7fd57f0-c0c6-4a05-8340-6bddafbc267f tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:04.536310 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f7fd57f0-c0c6-4a05-8340-6bddafbc267f tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:04.537089 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f7fd57f0-c0c6-4a05-8340-6bddafbc267f tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:04.537527 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f7fd57f0-c0c6-4a05-8340-6bddafbc267f tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:04.674852 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-f7fd57f0-c0c6-4a05-8340-6bddafbc267f tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:04.682272 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-f7fd57f0-c0c6-4a05-8340-6bddafbc267f tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1568 microversion: 2.1 time: 0.158180 May 23 12:39:04.682833 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 335/664] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:04 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:39:05.198061 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b47c6d01-9ebb-4a60-a9e9-805fc50c7c1e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:05.198685 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-b47c6d01-9ebb-4a60-a9e9-805fc50c7c1e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:05.206134 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b47c6d01-9ebb-4a60-a9e9-805fc50c7c1e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:05.206583 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b47c6d01-9ebb-4a60-a9e9-805fc50c7c1e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:05.207368 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b47c6d01-9ebb-4a60-a9e9-805fc50c7c1e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:05.207810 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b47c6d01-9ebb-4a60-a9e9-805fc50c7c1e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:05.342503 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b47c6d01-9ebb-4a60-a9e9-805fc50c7c1e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:05.350442 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b47c6d01-9ebb-4a60-a9e9-805fc50c7c1e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:05.351936 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b47c6d01-9ebb-4a60-a9e9-805fc50c7c1e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:05.353108 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b47c6d01-9ebb-4a60-a9e9-805fc50c7c1e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.158972 May 23 12:39:05.353657 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 330/665] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:39:05 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:39:05.698804 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-608dd9cc-c01f-463b-bb01-5221882df793 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:05.699408 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-608dd9cc-c01f-463b-bb01-5221882df793 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:05.706644 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-608dd9cc-c01f-463b-bb01-5221882df793 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:05.707089 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-608dd9cc-c01f-463b-bb01-5221882df793 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:05.707845 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-608dd9cc-c01f-463b-bb01-5221882df793 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:05.708306 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-608dd9cc-c01f-463b-bb01-5221882df793 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:05.840638 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-608dd9cc-c01f-463b-bb01-5221882df793 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:05.849134 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-608dd9cc-c01f-463b-bb01-5221882df793 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1568 microversion: 2.1 time: 0.154211 May 23 12:39:05.849694 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 336/666] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:05 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:39:06.371474 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-76c775e4-151d-4513-8fcb-1ee7c3a8ba8e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:06.372066 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-76c775e4-151d-4513-8fcb-1ee7c3a8ba8e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:06.375274 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:06.383381 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-76c775e4-151d-4513-8fcb-1ee7c3a8ba8e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:06.384162 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-76c775e4-151d-4513-8fcb-1ee7c3a8ba8e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:06.385632 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-76c775e4-151d-4513-8fcb-1ee7c3a8ba8e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:06.386429 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-76c775e4-151d-4513-8fcb-1ee7c3a8ba8e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:06.527090 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-76c775e4-151d-4513-8fcb-1ee7c3a8ba8e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:06.535283 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-76c775e4-151d-4513-8fcb-1ee7c3a8ba8e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:06.536742 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-76c775e4-151d-4513-8fcb-1ee7c3a8ba8e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:06.537893 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-76c775e4-151d-4513-8fcb-1ee7c3a8ba8e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.170420 May 23 12:39:06.538444 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 331/667] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:39:06 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:39:06.866573 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-c5cfcca2-7ff4-4ac5-8dac-10b253c5b128 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:06.867188 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-c5cfcca2-7ff4-4ac5-8dac-10b253c5b128 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:06.873698 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c5cfcca2-7ff4-4ac5-8dac-10b253c5b128 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:06.874494 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c5cfcca2-7ff4-4ac5-8dac-10b253c5b128 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:06.875074 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c5cfcca2-7ff4-4ac5-8dac-10b253c5b128 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:06.875510 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c5cfcca2-7ff4-4ac5-8dac-10b253c5b128 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:07.008293 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-c5cfcca2-7ff4-4ac5-8dac-10b253c5b128 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:07.016503 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-c5cfcca2-7ff4-4ac5-8dac-10b253c5b128 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1568 microversion: 2.1 time: 0.153818 May 23 12:39:07.017103 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 337/668] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:06 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:39:07.556558 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-08f38e25-758e-47c3-ad4a-3412e9e1bec8 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:07.557170 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-08f38e25-758e-47c3-ad4a-3412e9e1bec8 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:07.564399 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-08f38e25-758e-47c3-ad4a-3412e9e1bec8 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:07.564990 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-08f38e25-758e-47c3-ad4a-3412e9e1bec8 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:07.565755 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-08f38e25-758e-47c3-ad4a-3412e9e1bec8 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:07.566190 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-08f38e25-758e-47c3-ad4a-3412e9e1bec8 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:07.716127 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-08f38e25-758e-47c3-ad4a-3412e9e1bec8 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:07.724951 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-08f38e25-758e-47c3-ad4a-3412e9e1bec8 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:07.726483 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-08f38e25-758e-47c3-ad4a-3412e9e1bec8 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:07.727749 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-08f38e25-758e-47c3-ad4a-3412e9e1bec8 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.175342 May 23 12:39:07.728376 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 332/669] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:39:07 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:39:08.034379 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-049884c2-3beb-4509-ba4e-50857dcfc171 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:08.034954 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-049884c2-3beb-4509-ba4e-50857dcfc171 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:08.041426 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-049884c2-3beb-4509-ba4e-50857dcfc171 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:08.041871 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-049884c2-3beb-4509-ba4e-50857dcfc171 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:08.042771 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-049884c2-3beb-4509-ba4e-50857dcfc171 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:08.043070 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-049884c2-3beb-4509-ba4e-50857dcfc171 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:08.173186 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-049884c2-3beb-4509-ba4e-50857dcfc171 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:08.180611 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-049884c2-3beb-4509-ba4e-50857dcfc171 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1568 microversion: 2.1 time: 0.150587 May 23 12:39:08.181167 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 338/670] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:08 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:39:08.746971 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-10c39a5b-eb27-48d1-95f7-032c9cb76e30 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:08.747582 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-10c39a5b-eb27-48d1-95f7-032c9cb76e30 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:08.754221 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-10c39a5b-eb27-48d1-95f7-032c9cb76e30 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:08.754675 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-10c39a5b-eb27-48d1-95f7-032c9cb76e30 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:08.755466 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-10c39a5b-eb27-48d1-95f7-032c9cb76e30 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:08.755890 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-10c39a5b-eb27-48d1-95f7-032c9cb76e30 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:08.889957 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-10c39a5b-eb27-48d1-95f7-032c9cb76e30 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:08.898830 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-10c39a5b-eb27-48d1-95f7-032c9cb76e30 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:08.900302 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-10c39a5b-eb27-48d1-95f7-032c9cb76e30 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:08.901457 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-10c39a5b-eb27-48d1-95f7-032c9cb76e30 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.158463 May 23 12:39:08.902019 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 333/671] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:39:08 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:39:09.197848 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-fbada67f-41b3-488a-9336-87e2705ce0d7 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:09.198361 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-fbada67f-41b3-488a-9336-87e2705ce0d7 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:09.205817 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-fbada67f-41b3-488a-9336-87e2705ce0d7 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:09.206260 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-fbada67f-41b3-488a-9336-87e2705ce0d7 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:09.207023 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-fbada67f-41b3-488a-9336-87e2705ce0d7 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:09.207462 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-fbada67f-41b3-488a-9336-87e2705ce0d7 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:09.340980 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-fbada67f-41b3-488a-9336-87e2705ce0d7 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:09.349370 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-fbada67f-41b3-488a-9336-87e2705ce0d7 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1568 microversion: 2.1 time: 0.155534 May 23 12:39:09.349929 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 339/672] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:09 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:39:09.920658 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c1e34717-17b6-4f34-a462-f674448233f8 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:09.921273 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c1e34717-17b6-4f34-a462-f674448233f8 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:09.927731 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c1e34717-17b6-4f34-a462-f674448233f8 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:09.928198 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c1e34717-17b6-4f34-a462-f674448233f8 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:09.928976 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c1e34717-17b6-4f34-a462-f674448233f8 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:09.929420 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c1e34717-17b6-4f34-a462-f674448233f8 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:10.066028 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c1e34717-17b6-4f34-a462-f674448233f8 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:10.073888 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c1e34717-17b6-4f34-a462-f674448233f8 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:10.075379 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c1e34717-17b6-4f34-a462-f674448233f8 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:10.076587 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c1e34717-17b6-4f34-a462-f674448233f8 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.159815 May 23 12:39:10.077548 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 334/673] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:39:09 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:39:10.366171 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-4e11e924-b97a-4db1-b370-780d924cb0a7 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:10.366775 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-4e11e924-b97a-4db1-b370-780d924cb0a7 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:10.369285 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:10.375272 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4e11e924-b97a-4db1-b370-780d924cb0a7 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:10.375729 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4e11e924-b97a-4db1-b370-780d924cb0a7 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:10.376549 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4e11e924-b97a-4db1-b370-780d924cb0a7 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:10.376983 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4e11e924-b97a-4db1-b370-780d924cb0a7 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:10.511584 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-4e11e924-b97a-4db1-b370-780d924cb0a7 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:10.513785 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:10.521718 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-4e11e924-b97a-4db1-b370-780d924cb0a7 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1568 microversion: 2.1 time: 0.159385 May 23 12:39:10.522275 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 340/674] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:10 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:39:11.096264 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-067bc1e4-874a-4d4b-b4bc-8cf5927c503a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:11.096864 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-067bc1e4-874a-4d4b-b4bc-8cf5927c503a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:11.103348 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-067bc1e4-874a-4d4b-b4bc-8cf5927c503a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:11.103801 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-067bc1e4-874a-4d4b-b4bc-8cf5927c503a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:11.104601 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-067bc1e4-874a-4d4b-b4bc-8cf5927c503a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:11.105040 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-067bc1e4-874a-4d4b-b4bc-8cf5927c503a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:11.234428 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-067bc1e4-874a-4d4b-b4bc-8cf5927c503a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:11.242416 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-067bc1e4-874a-4d4b-b4bc-8cf5927c503a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:11.243920 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-067bc1e4-874a-4d4b-b4bc-8cf5927c503a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:11.245093 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-067bc1e4-874a-4d4b-b4bc-8cf5927c503a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.153591 May 23 12:39:11.245654 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 335/675] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:39:11 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:39:11.540100 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-e1274e6c-1680-47c4-bda8-39f0958b07eb tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:11.540744 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-e1274e6c-1680-47c4-bda8-39f0958b07eb tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:11.548641 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e1274e6c-1680-47c4-bda8-39f0958b07eb tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:11.549122 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e1274e6c-1680-47c4-bda8-39f0958b07eb tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:11.549892 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e1274e6c-1680-47c4-bda8-39f0958b07eb tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:11.550324 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e1274e6c-1680-47c4-bda8-39f0958b07eb tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:11.685274 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-e1274e6c-1680-47c4-bda8-39f0958b07eb tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:11.693529 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-e1274e6c-1680-47c4-bda8-39f0958b07eb tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1568 microversion: 2.1 time: 0.157628 May 23 12:39:11.694093 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 341/676] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:11 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:39:12.263908 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-96e783da-3b04-4f4b-8324-6b4aab2a68ac tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:12.265519 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-96e783da-3b04-4f4b-8324-6b4aab2a68ac tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:12.272255 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-96e783da-3b04-4f4b-8324-6b4aab2a68ac tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:12.272767 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-96e783da-3b04-4f4b-8324-6b4aab2a68ac tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:12.273583 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-96e783da-3b04-4f4b-8324-6b4aab2a68ac tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:12.274020 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-96e783da-3b04-4f4b-8324-6b4aab2a68ac tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:12.407670 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-96e783da-3b04-4f4b-8324-6b4aab2a68ac tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:12.415656 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-96e783da-3b04-4f4b-8324-6b4aab2a68ac tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:12.417203 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-96e783da-3b04-4f4b-8324-6b4aab2a68ac tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:12.418382 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-96e783da-3b04-4f4b-8324-6b4aab2a68ac tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.158574 May 23 12:39:12.418944 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 336/677] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:39:12 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:39:12.689426 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-7131f3a7-c793-4b87-b684-80753aa00b68 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:12.690460 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-7131f3a7-c793-4b87-b684-80753aa00b68 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 9a267457-7f06-4312-87ce-2c47cdb2924d] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:12.697313 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7131f3a7-c793-4b87-b684-80753aa00b68 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:12.697768 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7131f3a7-c793-4b87-b684-80753aa00b68 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:12.698939 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7131f3a7-c793-4b87-b684-80753aa00b68 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:12.699658 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7131f3a7-c793-4b87-b684-80753aa00b68 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:12.710635 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-2a33b975-84c6-40f5-820d-e45f885da503 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:12.711343 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-2a33b975-84c6-40f5-820d-e45f885da503 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:12.719055 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2a33b975-84c6-40f5-820d-e45f885da503 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:12.719579 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2a33b975-84c6-40f5-820d-e45f885da503 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:12.720397 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2a33b975-84c6-40f5-820d-e45f885da503 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:12.720830 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2a33b975-84c6-40f5-820d-e45f885da503 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:12.730314 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-7131f3a7-c793-4b87-b684-80753aa00b68 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044840 May 23 12:39:12.730881 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 342/678] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 12:39:12 2022] GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:39:12.741391 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-4209d6d4-d287-4cf9-8be5-9052bbc451b2 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:12.741876 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-4209d6d4-d287-4cf9-8be5-9052bbc451b2 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 9a267457-7f06-4312-87ce-2c47cdb2924d] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:12.747824 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4209d6d4-d287-4cf9-8be5-9052bbc451b2 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:12.748304 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4209d6d4-d287-4cf9-8be5-9052bbc451b2 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:12.749260 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4209d6d4-d287-4cf9-8be5-9052bbc451b2 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:12.749709 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4209d6d4-d287-4cf9-8be5-9052bbc451b2 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:12.781317 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-4209d6d4-d287-4cf9-8be5-9052bbc451b2 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d/os-volume_attachments/ca6b14ed-ab0f-48f7-bcca-5f5b7a27f0ab" status: 200 len: 194 microversion: 2.1 time: 0.043363 May 23 12:39:12.782264 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 343/679] 10.222.0.16 () {58 vars in 1412 bytes} [Mon May 23 12:39:12 2022] GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d/os-volume_attachments/ca6b14ed-ab0f-48f7-bcca-5f5b7a27f0ab => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:39:12.871734 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-2a33b975-84c6-40f5-820d-e45f885da503 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:12.879512 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-2a33b975-84c6-40f5-820d-e45f885da503 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1568 microversion: 2.1 time: 0.172731 May 23 12:39:12.880111 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 337/680] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:12 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:39:13.438255 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-0f4bed6b-4a10-422d-9306-46f96df26bbb tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:13.438764 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-0f4bed6b-4a10-422d-9306-46f96df26bbb tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:13.444847 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0f4bed6b-4a10-422d-9306-46f96df26bbb tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:13.445310 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0f4bed6b-4a10-422d-9306-46f96df26bbb tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:13.446087 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0f4bed6b-4a10-422d-9306-46f96df26bbb tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:13.446530 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0f4bed6b-4a10-422d-9306-46f96df26bbb tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:13.574126 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-0f4bed6b-4a10-422d-9306-46f96df26bbb tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:13.583546 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-0f4bed6b-4a10-422d-9306-46f96df26bbb tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:13.585569 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-0f4bed6b-4a10-422d-9306-46f96df26bbb tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:13.586812 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-0f4bed6b-4a10-422d-9306-46f96df26bbb tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.153209 May 23 12:39:13.587374 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 344/681] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:39:13 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:39:13.897008 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-e136e0fb-768e-4d01-a2c3-17b47e0f517c tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:13.897614 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-e136e0fb-768e-4d01-a2c3-17b47e0f517c tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:13.904049 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e136e0fb-768e-4d01-a2c3-17b47e0f517c tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:13.904630 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e136e0fb-768e-4d01-a2c3-17b47e0f517c tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:13.905458 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e136e0fb-768e-4d01-a2c3-17b47e0f517c tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:13.905900 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e136e0fb-768e-4d01-a2c3-17b47e0f517c tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:14.035946 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-e136e0fb-768e-4d01-a2c3-17b47e0f517c tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:14.043687 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-e136e0fb-768e-4d01-a2c3-17b47e0f517c tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1568 microversion: 2.1 time: 0.150590 May 23 12:39:14.044279 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 338/682] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:13 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:39:14.094890 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-8a24de12-c079-4f38-8983-dbd9d1850216 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cca9080f-19bd-4249-83fe-60ffb14c6a19"}} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:39:14.095946 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-8a24de12-c079-4f38-8983-dbd9d1850216 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 9a267457-7f06-4312-87ce-2c47cdb2924d] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:14.102507 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8a24de12-c079-4f38-8983-dbd9d1850216 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:14.102953 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8a24de12-c079-4f38-8983-dbd9d1850216 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:14.103720 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8a24de12-c079-4f38-8983-dbd9d1850216 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:14.104158 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8a24de12-c079-4f38-8983-dbd9d1850216 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:14.604954 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-509eea45-351e-4d8d-ac3b-996736f311c9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:14.605591 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-509eea45-351e-4d8d-ac3b-996736f311c9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:14.614087 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-509eea45-351e-4d8d-ac3b-996736f311c9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:14.614542 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-509eea45-351e-4d8d-ac3b-996736f311c9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:14.615311 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-509eea45-351e-4d8d-ac3b-996736f311c9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:14.615753 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-509eea45-351e-4d8d-ac3b-996736f311c9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:14.746330 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-509eea45-351e-4d8d-ac3b-996736f311c9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:14.754371 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-509eea45-351e-4d8d-ac3b-996736f311c9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:14.755868 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-509eea45-351e-4d8d-ac3b-996736f311c9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:14.757048 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-509eea45-351e-4d8d-ac3b-996736f311c9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.156006 May 23 12:39:14.757603 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 339/683] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:39:14 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:39:15.064053 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-1f1dd5c8-d172-47f3-be6b-8862f8720b21 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:15.065220 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-1f1dd5c8-d172-47f3-be6b-8862f8720b21 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:15.073466 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1f1dd5c8-d172-47f3-be6b-8862f8720b21 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:15.073919 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1f1dd5c8-d172-47f3-be6b-8862f8720b21 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:15.074873 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1f1dd5c8-d172-47f3-be6b-8862f8720b21 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:15.075371 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1f1dd5c8-d172-47f3-be6b-8862f8720b21 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:15.207081 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1f1dd5c8-d172-47f3-be6b-8862f8720b21 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:15.214535 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-1f1dd5c8-d172-47f3-be6b-8862f8720b21 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1568 microversion: 2.1 time: 0.156119 May 23 12:39:15.215099 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 340/684] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:15 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:39:15.450987 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-001316c7-5fbb-478e-a2ac-eb34bfa556c3 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:15.451584 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-001316c7-5fbb-478e-a2ac-eb34bfa556c3 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 203877da-d78e-44f0-bc6a-995008fef4f7] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:15.458147 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-001316c7-5fbb-478e-a2ac-eb34bfa556c3 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:15.458591 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-001316c7-5fbb-478e-a2ac-eb34bfa556c3 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:15.459354 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-001316c7-5fbb-478e-a2ac-eb34bfa556c3 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:15.459788 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-001316c7-5fbb-478e-a2ac-eb34bfa556c3 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:15.462217 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:15.485308 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-001316c7-5fbb-478e-a2ac-eb34bfa556c3 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7/ips" status: 200 len: 149 microversion: 2.1 time: 0.038356 May 23 12:39:15.485870 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 341/685] 10.222.0.16 () {58 vars in 1247 bytes} [Mon May 23 12:39:15 2022] GET /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:39:15.775175 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d41889b5-d8ab-4620-a1b3-df5549e58e70 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:15.775788 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d41889b5-d8ab-4620-a1b3-df5549e58e70 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:15.782681 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d41889b5-d8ab-4620-a1b3-df5549e58e70 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:15.783134 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d41889b5-d8ab-4620-a1b3-df5549e58e70 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:15.783954 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d41889b5-d8ab-4620-a1b3-df5549e58e70 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:15.784428 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d41889b5-d8ab-4620-a1b3-df5549e58e70 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:15.917119 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d41889b5-d8ab-4620-a1b3-df5549e58e70 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:15.925809 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d41889b5-d8ab-4620-a1b3-df5549e58e70 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:15.927292 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d41889b5-d8ab-4620-a1b3-df5549e58e70 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:15.928458 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d41889b5-d8ab-4620-a1b3-df5549e58e70 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.157194 May 23 12:39:15.929010 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 342/686] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:39:15 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:39:16.231657 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-3fe325af-9101-4834-98db-c7021641ab06 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:16.232353 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-3fe325af-9101-4834-98db-c7021641ab06 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:16.239214 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3fe325af-9101-4834-98db-c7021641ab06 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:16.239673 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3fe325af-9101-4834-98db-c7021641ab06 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:16.240540 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3fe325af-9101-4834-98db-c7021641ab06 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:16.240986 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3fe325af-9101-4834-98db-c7021641ab06 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:16.369665 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-3fe325af-9101-4834-98db-c7021641ab06 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:16.378752 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-3fe325af-9101-4834-98db-c7021641ab06 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1568 microversion: 2.1 time: 0.150806 May 23 12:39:16.379459 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 343/687] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:16 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:39:16.679546 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-8a24de12-c079-4f38-8983-dbd9d1850216 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "POST /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.588419 May 23 12:39:16.680278 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 345/688] 10.222.0.16 () {60 vars in 1322 bytes} [Mon May 23 12:39:14 2022] POST /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d/os-volume_attachments => generated 194 bytes in 2590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:39:16.806731 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-e14bd475-d2e4-4d53-a347-5c2d319deae5 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60317fbc-3c51-416e-980d-4ca8df9ca023"}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:39:16.808153 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-e14bd475-d2e4-4d53-a347-5c2d319deae5 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 203877da-d78e-44f0-bc6a-995008fef4f7] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:16.814889 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e14bd475-d2e4-4d53-a347-5c2d319deae5 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:16.815342 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e14bd475-d2e4-4d53-a347-5c2d319deae5 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:16.816114 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e14bd475-d2e4-4d53-a347-5c2d319deae5 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:16.816575 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e14bd475-d2e4-4d53-a347-5c2d319deae5 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:16.949358 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-ee446404-8bac-4e56-839a-1ba3c182e1ef tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:16.950358 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-ee446404-8bac-4e56-839a-1ba3c182e1ef tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:16.958284 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ee446404-8bac-4e56-839a-1ba3c182e1ef tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:16.958736 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ee446404-8bac-4e56-839a-1ba3c182e1ef tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:16.959515 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ee446404-8bac-4e56-839a-1ba3c182e1ef tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:16.960143 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ee446404-8bac-4e56-839a-1ba3c182e1ef tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:17.118265 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-e14bd475-d2e4-4d53-a347-5c2d319deae5 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "POST /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.315355 May 23 12:39:17.119394 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 344/689] 10.222.0.16 () {60 vars in 1322 bytes} [Mon May 23 12:39:16 2022] POST /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:39:17.121607 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-ee446404-8bac-4e56-839a-1ba3c182e1ef tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:17.161042 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-ee446404-8bac-4e56-839a-1ba3c182e1ef tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:17.162858 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-ee446404-8bac-4e56-839a-1ba3c182e1ef tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:17.164263 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-ee446404-8bac-4e56-839a-1ba3c182e1ef tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.219586 May 23 12:39:17.168787 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 346/690] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:39:16 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:39:17.396686 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d02d8352-0696-4a4f-9725-e89f142b01bc tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:17.397380 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d02d8352-0696-4a4f-9725-e89f142b01bc tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:17.403627 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d02d8352-0696-4a4f-9725-e89f142b01bc tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:17.404067 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d02d8352-0696-4a4f-9725-e89f142b01bc tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:17.404860 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d02d8352-0696-4a4f-9725-e89f142b01bc tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:17.405294 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d02d8352-0696-4a4f-9725-e89f142b01bc tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:17.546097 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d02d8352-0696-4a4f-9725-e89f142b01bc tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:17.553938 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d02d8352-0696-4a4f-9725-e89f142b01bc tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1568 microversion: 2.1 time: 0.162244 May 23 12:39:17.554590 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 345/691] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:17 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:39:18.183818 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-2fa3086b-2b71-414b-9237-e9c09a40dfbc tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:18.184593 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-2fa3086b-2b71-414b-9237-e9c09a40dfbc tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:18.191429 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2fa3086b-2b71-414b-9237-e9c09a40dfbc tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:18.191885 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2fa3086b-2b71-414b-9237-e9c09a40dfbc tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:18.192695 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2fa3086b-2b71-414b-9237-e9c09a40dfbc tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:18.193137 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2fa3086b-2b71-414b-9237-e9c09a40dfbc tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:18.321758 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-2fa3086b-2b71-414b-9237-e9c09a40dfbc tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:18.330702 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-2fa3086b-2b71-414b-9237-e9c09a40dfbc tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:18.332239 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-2fa3086b-2b71-414b-9237-e9c09a40dfbc tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:18.333391 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-2fa3086b-2b71-414b-9237-e9c09a40dfbc tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.153775 May 23 12:39:18.333953 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 347/692] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:39:18 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:39:18.570831 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-35c20edc-5585-4549-90dd-3e8063c0a068 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:18.571381 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-35c20edc-5585-4549-90dd-3e8063c0a068 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:18.577980 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-35c20edc-5585-4549-90dd-3e8063c0a068 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:18.579226 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-35c20edc-5585-4549-90dd-3e8063c0a068 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:18.580024 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-35c20edc-5585-4549-90dd-3e8063c0a068 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:18.580495 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-35c20edc-5585-4549-90dd-3e8063c0a068 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:18.725661 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-35c20edc-5585-4549-90dd-3e8063c0a068 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:18.735252 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-35c20edc-5585-4549-90dd-3e8063c0a068 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1568 microversion: 2.1 time: 0.168257 May 23 12:39:18.736232 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 346/693] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:18 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:39:19.351803 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-0b3b617d-532c-493b-b746-41f85ab315be tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:19.352439 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-0b3b617d-532c-493b-b746-41f85ab315be tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:19.358889 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0b3b617d-532c-493b-b746-41f85ab315be tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:19.359361 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0b3b617d-532c-493b-b746-41f85ab315be tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:19.360926 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0b3b617d-532c-493b-b746-41f85ab315be tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:19.361538 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0b3b617d-532c-493b-b746-41f85ab315be tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:19.497498 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-0b3b617d-532c-493b-b746-41f85ab315be tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:19.505584 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-0b3b617d-532c-493b-b746-41f85ab315be tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:19.507037 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-0b3b617d-532c-493b-b746-41f85ab315be tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:19.508462 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-0b3b617d-532c-493b-b746-41f85ab315be tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.160322 May 23 12:39:19.509063 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 348/694] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:39:19 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:39:19.752957 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-a939d2d4-4ff5-4c85-b905-69a6e7f7a615 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:19.753558 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-a939d2d4-4ff5-4c85-b905-69a6e7f7a615 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:19.760243 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a939d2d4-4ff5-4c85-b905-69a6e7f7a615 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:19.760622 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a939d2d4-4ff5-4c85-b905-69a6e7f7a615 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:19.761395 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a939d2d4-4ff5-4c85-b905-69a6e7f7a615 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:19.761827 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a939d2d4-4ff5-4c85-b905-69a6e7f7a615 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:19.897766 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-a939d2d4-4ff5-4c85-b905-69a6e7f7a615 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:19.905311 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-a939d2d4-4ff5-4c85-b905-69a6e7f7a615 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1569 microversion: 2.1 time: 0.156606 May 23 12:39:19.905880 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 347/695] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:19 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:39:19.922199 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-370773ba-34c4-46e4-84f5-98e76108ed72 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:39:19.922948 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-370773ba-34c4-46e4-84f5-98e76108ed72 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:19.928957 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-370773ba-34c4-46e4-84f5-98e76108ed72 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:19.929411 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-370773ba-34c4-46e4-84f5-98e76108ed72 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:19.930176 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-370773ba-34c4-46e4-84f5-98e76108ed72 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:19.930616 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-370773ba-34c4-46e4-84f5-98e76108ed72 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:20.015672 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-370773ba-34c4-46e4-84f5-98e76108ed72 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "POST /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed/action" status: 202 len: 0 microversion: 2.1 time: 0.097187 May 23 12:39:20.016666 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 349/696] 10.222.0.16 () {60 vars in 1277 bytes} [Mon May 23 12:39:19 2022] POST /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:39:20.029423 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b69b7ad6-278f-4da1-ac6e-d9823bc1df34 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:20.030171 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-b69b7ad6-278f-4da1-ac6e-d9823bc1df34 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:20.037961 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b69b7ad6-278f-4da1-ac6e-d9823bc1df34 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:20.038422 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b69b7ad6-278f-4da1-ac6e-d9823bc1df34 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:20.039603 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b69b7ad6-278f-4da1-ac6e-d9823bc1df34 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:20.040050 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b69b7ad6-278f-4da1-ac6e-d9823bc1df34 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:20.226998 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b69b7ad6-278f-4da1-ac6e-d9823bc1df34 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:20.234471 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b69b7ad6-278f-4da1-ac6e-d9823bc1df34 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1577 microversion: 2.1 time: 0.213232 May 23 12:39:20.235046 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 348/697] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:20 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1577 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:39:20.527700 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-bc8db678-b459-42b9-af95-bd3ee4e1c18e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:20.528263 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-bc8db678-b459-42b9-af95-bd3ee4e1c18e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:20.534406 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-bc8db678-b459-42b9-af95-bd3ee4e1c18e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:20.534859 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-bc8db678-b459-42b9-af95-bd3ee4e1c18e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:20.535633 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-bc8db678-b459-42b9-af95-bd3ee4e1c18e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:20.536071 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-bc8db678-b459-42b9-af95-bd3ee4e1c18e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:20.667576 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-bc8db678-b459-42b9-af95-bd3ee4e1c18e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:20.676251 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-bc8db678-b459-42b9-af95-bd3ee4e1c18e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:20.677779 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-bc8db678-b459-42b9-af95-bd3ee4e1c18e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:20.678953 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-bc8db678-b459-42b9-af95-bd3ee4e1c18e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.156042 May 23 12:39:20.679514 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 350/698] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:39:20 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:39:21.251046 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-93fd70e9-60cc-4395-85ac-17527029be5a tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:21.251700 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-93fd70e9-60cc-4395-85ac-17527029be5a tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:21.258437 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-93fd70e9-60cc-4395-85ac-17527029be5a tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:21.258824 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-93fd70e9-60cc-4395-85ac-17527029be5a tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:21.259587 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-93fd70e9-60cc-4395-85ac-17527029be5a tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:21.260020 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-93fd70e9-60cc-4395-85ac-17527029be5a tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:21.395479 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-93fd70e9-60cc-4395-85ac-17527029be5a tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:21.403425 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-93fd70e9-60cc-4395-85ac-17527029be5a tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1577 microversion: 2.1 time: 0.156393 May 23 12:39:21.404069 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 349/699] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:21 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:39:21.697522 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-76ed8197-8d2e-4baa-92f0-c5157717f91b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:21.698124 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-76ed8197-8d2e-4baa-92f0-c5157717f91b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:21.704851 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-76ed8197-8d2e-4baa-92f0-c5157717f91b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:21.705295 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-76ed8197-8d2e-4baa-92f0-c5157717f91b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:21.706817 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-76ed8197-8d2e-4baa-92f0-c5157717f91b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:21.707429 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-76ed8197-8d2e-4baa-92f0-c5157717f91b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:21.839440 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-76ed8197-8d2e-4baa-92f0-c5157717f91b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:21.847586 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-76ed8197-8d2e-4baa-92f0-c5157717f91b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:21.849714 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-76ed8197-8d2e-4baa-92f0-c5157717f91b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:21.851855 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-76ed8197-8d2e-4baa-92f0-c5157717f91b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.157943 May 23 12:39:21.852910 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 351/700] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:39:21 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:39:22.421329 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-35b80c8d-f947-4c84-823f-fad6ad02847c tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:22.421983 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-35b80c8d-f947-4c84-823f-fad6ad02847c tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:22.431821 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-35b80c8d-f947-4c84-823f-fad6ad02847c tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:22.434403 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-35b80c8d-f947-4c84-823f-fad6ad02847c tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:22.435261 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-35b80c8d-f947-4c84-823f-fad6ad02847c tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:22.437317 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-35b80c8d-f947-4c84-823f-fad6ad02847c tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:22.531540 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-b3bb569d-2329-4d08-a91b-cb10f1295a3a req-ebdcdadf-8f26-467e-ac1b-a6bc5ee082cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1acfc6ec-6e8f-4969-99e8-0de456fcb7ed", "name": "network-vif-unplugged", "status": "completed", "tag": "6629f354-c1e7-44f4-90fa-1e340bce002d"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:39:22.540258 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-b3bb569d-2329-4d08-a91b-cb10f1295a3a req-ebdcdadf-8f26-467e-ac1b-a6bc5ee082cb service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:22.540651 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-b3bb569d-2329-4d08-a91b-cb10f1295a3a req-ebdcdadf-8f26-467e-ac1b-a6bc5ee082cb service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:22.551777 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.compute.server_external_events [req-b3bb569d-2329-4d08-a91b-cb10f1295a3a req-ebdcdadf-8f26-467e-ac1b-a6bc5ee082cb service nova] Unable to find a host for instance 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed. Dropping event network-vif-unplugged {{(pid=124199) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 23 12:39:22.552711 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-b3bb569d-2329-4d08-a91b-cb10f1295a3a req-ebdcdadf-8f26-467e-ac1b-a6bc5ee082cb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.183611 May 23 12:39:22.553303 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 350/701] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 185 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 23 12:39:22.574976 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-35b80c8d-f947-4c84-823f-fad6ad02847c tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:22.583270 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-35b80c8d-f947-4c84-823f-fad6ad02847c tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1519 microversion: 2.1 time: 0.165889 May 23 12:39:22.583844 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 352/702] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:22 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:39:22.870437 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-1b6e279a-2e4d-405a-943e-d25cf68b5d99 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:22.871342 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-1b6e279a-2e4d-405a-943e-d25cf68b5d99 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:22.877542 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1b6e279a-2e4d-405a-943e-d25cf68b5d99 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:22.878660 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1b6e279a-2e4d-405a-943e-d25cf68b5d99 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:22.879440 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1b6e279a-2e4d-405a-943e-d25cf68b5d99 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:22.879943 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1b6e279a-2e4d-405a-943e-d25cf68b5d99 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:23.014123 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1b6e279a-2e4d-405a-943e-d25cf68b5d99 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:23.022376 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1b6e279a-2e4d-405a-943e-d25cf68b5d99 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:23.023886 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1b6e279a-2e4d-405a-943e-d25cf68b5d99 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:23.025073 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-1b6e279a-2e4d-405a-943e-d25cf68b5d99 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.158542 May 23 12:39:23.025637 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 351/703] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:39:22 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:39:23.601345 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-b8fad7e8-be32-4b77-ab4c-fe060612cab7 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:23.601980 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-b8fad7e8-be32-4b77-ab4c-fe060612cab7 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:23.608530 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b8fad7e8-be32-4b77-ab4c-fe060612cab7 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:23.608976 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b8fad7e8-be32-4b77-ab4c-fe060612cab7 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:23.609732 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b8fad7e8-be32-4b77-ab4c-fe060612cab7 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:23.610162 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b8fad7e8-be32-4b77-ab4c-fe060612cab7 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:23.739682 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-b8fad7e8-be32-4b77-ab4c-fe060612cab7 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:23.748487 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-b8fad7e8-be32-4b77-ab4c-fe060612cab7 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1519 microversion: 2.1 time: 0.151834 May 23 12:39:23.749064 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 353/704] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:23 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:39:24.044688 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-6c4866e8-ec60-4edd-b926-1dfc9d0b47cf tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:24.045307 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-6c4866e8-ec60-4edd-b926-1dfc9d0b47cf tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:24.053659 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6c4866e8-ec60-4edd-b926-1dfc9d0b47cf tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:24.054149 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6c4866e8-ec60-4edd-b926-1dfc9d0b47cf tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:24.054948 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6c4866e8-ec60-4edd-b926-1dfc9d0b47cf tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:24.055392 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6c4866e8-ec60-4edd-b926-1dfc9d0b47cf tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:24.184114 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-6c4866e8-ec60-4edd-b926-1dfc9d0b47cf tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:24.192098 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-6c4866e8-ec60-4edd-b926-1dfc9d0b47cf tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:24.193629 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-6c4866e8-ec60-4edd-b926-1dfc9d0b47cf tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:24.194788 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-6c4866e8-ec60-4edd-b926-1dfc9d0b47cf tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.154461 May 23 12:39:24.195354 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 352/705] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:39:24 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:39:24.765299 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-501f83b6-94bc-4f4b-89e5-09dca615329e tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:24.765833 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-501f83b6-94bc-4f4b-89e5-09dca615329e tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:24.773372 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-501f83b6-94bc-4f4b-89e5-09dca615329e tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:24.773817 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-501f83b6-94bc-4f4b-89e5-09dca615329e tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:24.774571 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-501f83b6-94bc-4f4b-89e5-09dca615329e tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:24.775002 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-501f83b6-94bc-4f4b-89e5-09dca615329e tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:24.907727 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-501f83b6-94bc-4f4b-89e5-09dca615329e tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:24.915456 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-501f83b6-94bc-4f4b-89e5-09dca615329e tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1519 microversion: 2.1 time: 0.154121 May 23 12:39:24.916022 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 354/706] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:24 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:39:25.213289 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-70db1f34-57fe-4543-9ed1-f4bbea3cddec tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:25.213923 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-70db1f34-57fe-4543-9ed1-f4bbea3cddec tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:25.220367 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-70db1f34-57fe-4543-9ed1-f4bbea3cddec tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:25.220813 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-70db1f34-57fe-4543-9ed1-f4bbea3cddec tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:25.221572 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-70db1f34-57fe-4543-9ed1-f4bbea3cddec tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:25.222004 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-70db1f34-57fe-4543-9ed1-f4bbea3cddec tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:25.352229 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-70db1f34-57fe-4543-9ed1-f4bbea3cddec tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:25.360192 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-70db1f34-57fe-4543-9ed1-f4bbea3cddec tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:25.361694 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-70db1f34-57fe-4543-9ed1-f4bbea3cddec tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:25.363019 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-70db1f34-57fe-4543-9ed1-f4bbea3cddec tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.153588 May 23 12:39:25.363590 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 353/707] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:39:25 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:39:25.367980 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-5385281a-ca87-43c4-a6fc-4f0ce914d617 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:25.369011 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-5385281a-ca87-43c4-a6fc-4f0ce914d617 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 9a267457-7f06-4312-87ce-2c47cdb2924d] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:25.375186 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5385281a-ca87-43c4-a6fc-4f0ce914d617 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:25.375669 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5385281a-ca87-43c4-a6fc-4f0ce914d617 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:25.376485 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5385281a-ca87-43c4-a6fc-4f0ce914d617 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:25.376925 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5385281a-ca87-43c4-a6fc-4f0ce914d617 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:25.380785 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:25.411382 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-5385281a-ca87-43c4-a6fc-4f0ce914d617 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047615 May 23 12:39:25.411948 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 355/708] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 12:39:25 2022] GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:39:25.549845 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-6cc7747f-60ef-4d3b-b748-4743bccafb08 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:25.550340 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-6cc7747f-60ef-4d3b-b748-4743bccafb08 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 9a267457-7f06-4312-87ce-2c47cdb2924d] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:25.557252 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6cc7747f-60ef-4d3b-b748-4743bccafb08 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:25.557703 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6cc7747f-60ef-4d3b-b748-4743bccafb08 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:25.558465 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6cc7747f-60ef-4d3b-b748-4743bccafb08 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:25.558904 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6cc7747f-60ef-4d3b-b748-4743bccafb08 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:25.587549 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-6cc7747f-60ef-4d3b-b748-4743bccafb08 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d/os-volume_attachments/ca6b14ed-ab0f-48f7-bcca-5f5b7a27f0ab" status: 200 len: 194 microversion: 2.1 time: 0.041624 May 23 12:39:25.588442 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 354/709] 10.222.0.16 () {58 vars in 1412 bytes} [Mon May 23 12:39:25 2022] GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d/os-volume_attachments/ca6b14ed-ab0f-48f7-bcca-5f5b7a27f0ab => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:39:25.597839 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-3cdafd3d-9cdf-4dd5-87ac-c24dd0387e8f tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:25.598862 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-3cdafd3d-9cdf-4dd5-87ac-c24dd0387e8f tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 9a267457-7f06-4312-87ce-2c47cdb2924d] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:25.605116 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3cdafd3d-9cdf-4dd5-87ac-c24dd0387e8f tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:25.605602 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3cdafd3d-9cdf-4dd5-87ac-c24dd0387e8f tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:25.606390 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3cdafd3d-9cdf-4dd5-87ac-c24dd0387e8f tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:25.606813 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3cdafd3d-9cdf-4dd5-87ac-c24dd0387e8f tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:25.690860 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.objects.instance [None req-3cdafd3d-9cdf-4dd5-87ac-c24dd0387e8f tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lazy-loading 'services' on Instance uuid 9a267457-7f06-4312-87ce-2c47cdb2924d {{(pid=124200) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:39:25.764865 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-3cdafd3d-9cdf-4dd5-87ac-c24dd0387e8f tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d/os-volume_attachments/ca6b14ed-ab0f-48f7-bcca-5f5b7a27f0ab" status: 202 len: 0 microversion: 2.1 time: 0.170640 May 23 12:39:25.765742 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 356/710] 10.222.0.16 () {58 vars in 1415 bytes} [Mon May 23 12:39:25 2022] DELETE /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d/os-volume_attachments/ca6b14ed-ab0f-48f7-bcca-5f5b7a27f0ab => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:39:25.932613 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-cfbf10ea-bb7f-4577-aae8-fd5ae9f87fe0 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:25.933215 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-cfbf10ea-bb7f-4577-aae8-fd5ae9f87fe0 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:25.939157 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cfbf10ea-bb7f-4577-aae8-fd5ae9f87fe0 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:25.939600 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cfbf10ea-bb7f-4577-aae8-fd5ae9f87fe0 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:25.940384 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cfbf10ea-bb7f-4577-aae8-fd5ae9f87fe0 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:25.940823 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cfbf10ea-bb7f-4577-aae8-fd5ae9f87fe0 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:26.072077 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-cfbf10ea-bb7f-4577-aae8-fd5ae9f87fe0 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:26.080325 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-cfbf10ea-bb7f-4577-aae8-fd5ae9f87fe0 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1519 microversion: 2.1 time: 0.151467 May 23 12:39:26.080915 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 355/711] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:25 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:39:26.383197 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-152b709b-c44d-4437-ac73-4893e069a360 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:26.383897 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-152b709b-c44d-4437-ac73-4893e069a360 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:26.390772 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-152b709b-c44d-4437-ac73-4893e069a360 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:26.391213 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-152b709b-c44d-4437-ac73-4893e069a360 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:26.391983 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-152b709b-c44d-4437-ac73-4893e069a360 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:26.392481 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-152b709b-c44d-4437-ac73-4893e069a360 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:26.525105 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-152b709b-c44d-4437-ac73-4893e069a360 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:26.533431 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-152b709b-c44d-4437-ac73-4893e069a360 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:26.534940 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-152b709b-c44d-4437-ac73-4893e069a360 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:26.536091 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-152b709b-c44d-4437-ac73-4893e069a360 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.157889 May 23 12:39:26.536658 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 357/712] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:39:26 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:39:27.098971 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-08eface3-78be-469d-a294-1bb020651c68 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:27.099908 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-08eface3-78be-469d-a294-1bb020651c68 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:27.106543 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-08eface3-78be-469d-a294-1bb020651c68 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:27.106989 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-08eface3-78be-469d-a294-1bb020651c68 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:27.107753 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-08eface3-78be-469d-a294-1bb020651c68 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:27.108197 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-08eface3-78be-469d-a294-1bb020651c68 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:27.236977 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-08eface3-78be-469d-a294-1bb020651c68 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:27.244594 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-08eface3-78be-469d-a294-1bb020651c68 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1519 microversion: 2.1 time: 0.150080 May 23 12:39:27.245159 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 356/713] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:27 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:39:27.554579 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-1173c981-1c1b-4f77-8ef2-5f05c3c500a8 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:27.555367 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-1173c981-1c1b-4f77-8ef2-5f05c3c500a8 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:27.561936 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1173c981-1c1b-4f77-8ef2-5f05c3c500a8 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:27.562382 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1173c981-1c1b-4f77-8ef2-5f05c3c500a8 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:27.563146 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1173c981-1c1b-4f77-8ef2-5f05c3c500a8 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:27.563603 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1173c981-1c1b-4f77-8ef2-5f05c3c500a8 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:27.702631 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-1173c981-1c1b-4f77-8ef2-5f05c3c500a8 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:27.711039 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-1173c981-1c1b-4f77-8ef2-5f05c3c500a8 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:27.712570 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-1173c981-1c1b-4f77-8ef2-5f05c3c500a8 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:27.713732 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-1173c981-1c1b-4f77-8ef2-5f05c3c500a8 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.163101 May 23 12:39:27.714293 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 358/714] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:39:27 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:39:28.261678 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-19d63e37-a08a-4f32-a4c3-f91d8d283ffe tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:28.262218 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-19d63e37-a08a-4f32-a4c3-f91d8d283ffe tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:28.268786 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-19d63e37-a08a-4f32-a4c3-f91d8d283ffe tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:28.269239 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-19d63e37-a08a-4f32-a4c3-f91d8d283ffe tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:28.270599 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-19d63e37-a08a-4f32-a4c3-f91d8d283ffe tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:28.271043 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-19d63e37-a08a-4f32-a4c3-f91d8d283ffe tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:28.285877 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:28.407049 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-19d63e37-a08a-4f32-a4c3-f91d8d283ffe tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:28.414638 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-19d63e37-a08a-4f32-a4c3-f91d8d283ffe tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1519 microversion: 2.1 time: 0.157042 May 23 12:39:28.415208 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 357/715] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:28 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:39:28.731500 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-2fd515a7-719b-4f1a-bbca-c431f236fa33 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:28.732104 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-2fd515a7-719b-4f1a-bbca-c431f236fa33 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:28.739253 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2fd515a7-719b-4f1a-bbca-c431f236fa33 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:28.739934 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2fd515a7-719b-4f1a-bbca-c431f236fa33 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:28.740764 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2fd515a7-719b-4f1a-bbca-c431f236fa33 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:28.741203 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2fd515a7-719b-4f1a-bbca-c431f236fa33 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:28.903326 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-2fd515a7-719b-4f1a-bbca-c431f236fa33 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:28.913181 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-2fd515a7-719b-4f1a-bbca-c431f236fa33 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:28.914871 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-2fd515a7-719b-4f1a-bbca-c431f236fa33 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:28.916677 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-2fd515a7-719b-4f1a-bbca-c431f236fa33 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.188846 May 23 12:39:28.917606 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 359/716] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:39:28 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:39:29.432789 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-fe5a8a9e-f6c7-4839-b326-dd568758461d tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:29.433404 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-fe5a8a9e-f6c7-4839-b326-dd568758461d tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:29.439925 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fe5a8a9e-f6c7-4839-b326-dd568758461d tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:29.440409 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fe5a8a9e-f6c7-4839-b326-dd568758461d tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:29.441184 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fe5a8a9e-f6c7-4839-b326-dd568758461d tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:29.441620 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fe5a8a9e-f6c7-4839-b326-dd568758461d tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:29.575268 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-fe5a8a9e-f6c7-4839-b326-dd568758461d tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:29.583281 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-fe5a8a9e-f6c7-4839-b326-dd568758461d tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1519 microversion: 2.1 time: 0.154352 May 23 12:39:29.583850 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 358/717] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:29 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:39:29.942395 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-29fe4e0c-4928-4768-99c2-d84d77820f16 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:29.943097 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-29fe4e0c-4928-4768-99c2-d84d77820f16 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:29.949613 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-29fe4e0c-4928-4768-99c2-d84d77820f16 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:29.950049 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-29fe4e0c-4928-4768-99c2-d84d77820f16 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:29.950829 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-29fe4e0c-4928-4768-99c2-d84d77820f16 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:29.954356 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-29fe4e0c-4928-4768-99c2-d84d77820f16 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:30.091448 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-29fe4e0c-4928-4768-99c2-d84d77820f16 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:30.099654 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-29fe4e0c-4928-4768-99c2-d84d77820f16 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:30.101201 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-29fe4e0c-4928-4768-99c2-d84d77820f16 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:30.102366 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-29fe4e0c-4928-4768-99c2-d84d77820f16 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.164734 May 23 12:39:30.102913 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 360/718] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:39:29 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:39:30.601706 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f7b6eba0-6a52-4a08-9e29-6bcbd929efcf tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:30.602317 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-f7b6eba0-6a52-4a08-9e29-6bcbd929efcf tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:30.608933 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f7b6eba0-6a52-4a08-9e29-6bcbd929efcf tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:30.609386 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f7b6eba0-6a52-4a08-9e29-6bcbd929efcf tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:30.610149 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f7b6eba0-6a52-4a08-9e29-6bcbd929efcf tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:30.610586 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f7b6eba0-6a52-4a08-9e29-6bcbd929efcf tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:30.740162 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f7b6eba0-6a52-4a08-9e29-6bcbd929efcf tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:30.747777 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f7b6eba0-6a52-4a08-9e29-6bcbd929efcf tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1519 microversion: 2.1 time: 0.150807 May 23 12:39:30.748432 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 359/719] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:30 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:39:31.121125 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-c8de5515-ed03-4445-8bdf-65084260990f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:31.121730 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-c8de5515-ed03-4445-8bdf-65084260990f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:31.128215 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c8de5515-ed03-4445-8bdf-65084260990f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:31.128666 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c8de5515-ed03-4445-8bdf-65084260990f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:31.129418 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c8de5515-ed03-4445-8bdf-65084260990f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:31.130484 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c8de5515-ed03-4445-8bdf-65084260990f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:31.258924 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-c8de5515-ed03-4445-8bdf-65084260990f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:31.266793 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-c8de5515-ed03-4445-8bdf-65084260990f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:31.268313 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-c8de5515-ed03-4445-8bdf-65084260990f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:31.269457 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-c8de5515-ed03-4445-8bdf-65084260990f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.152292 May 23 12:39:31.270027 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 361/720] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:39:31 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:39:31.765469 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-26cf3cfe-2608-4e89-a3de-d1b9ea784bea tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:31.766086 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-26cf3cfe-2608-4e89-a3de-d1b9ea784bea tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:31.773090 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-26cf3cfe-2608-4e89-a3de-d1b9ea784bea tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:31.773552 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-26cf3cfe-2608-4e89-a3de-d1b9ea784bea tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:31.774309 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-26cf3cfe-2608-4e89-a3de-d1b9ea784bea tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:31.774754 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-26cf3cfe-2608-4e89-a3de-d1b9ea784bea tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:31.907044 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-26cf3cfe-2608-4e89-a3de-d1b9ea784bea tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:31.915480 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-26cf3cfe-2608-4e89-a3de-d1b9ea784bea tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1519 microversion: 2.1 time: 0.153894 May 23 12:39:31.916035 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 360/721] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:31 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:39:32.287271 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-ea4124e2-b010-46f3-b70e-9e38ff8a2a1b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:32.287880 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-ea4124e2-b010-46f3-b70e-9e38ff8a2a1b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:32.294490 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ea4124e2-b010-46f3-b70e-9e38ff8a2a1b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:32.294948 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ea4124e2-b010-46f3-b70e-9e38ff8a2a1b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:32.295726 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ea4124e2-b010-46f3-b70e-9e38ff8a2a1b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:32.296194 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ea4124e2-b010-46f3-b70e-9e38ff8a2a1b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:32.592621 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-ea4124e2-b010-46f3-b70e-9e38ff8a2a1b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:32.600992 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-ea4124e2-b010-46f3-b70e-9e38ff8a2a1b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:32.602531 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-ea4124e2-b010-46f3-b70e-9e38ff8a2a1b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:32.603695 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-ea4124e2-b010-46f3-b70e-9e38ff8a2a1b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.320489 May 23 12:39:32.604264 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 362/722] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:39:32 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:39:32.932798 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-e39c239e-840e-4726-bc58-273981a3892b tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:32.933986 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-e39c239e-840e-4726-bc58-273981a3892b tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:32.940598 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e39c239e-840e-4726-bc58-273981a3892b tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:32.941053 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e39c239e-840e-4726-bc58-273981a3892b tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:32.941828 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e39c239e-840e-4726-bc58-273981a3892b tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:32.942799 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e39c239e-840e-4726-bc58-273981a3892b tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:33.116433 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-e39c239e-840e-4726-bc58-273981a3892b tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:33.125798 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-e39c239e-840e-4726-bc58-273981a3892b tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1519 microversion: 2.1 time: 0.196868 May 23 12:39:33.126460 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 361/723] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:32 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1519 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:39:33.623187 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-8b5498e0-8b5a-4b09-87af-287bac8ff5bb tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:33.623798 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-8b5498e0-8b5a-4b09-87af-287bac8ff5bb tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:33.631816 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8b5498e0-8b5a-4b09-87af-287bac8ff5bb tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:33.632308 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8b5498e0-8b5a-4b09-87af-287bac8ff5bb tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:33.634682 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8b5498e0-8b5a-4b09-87af-287bac8ff5bb tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:33.635133 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8b5498e0-8b5a-4b09-87af-287bac8ff5bb tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:33.783263 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-8b5498e0-8b5a-4b09-87af-287bac8ff5bb tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:33.794360 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-8b5498e0-8b5a-4b09-87af-287bac8ff5bb tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:33.795858 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-8b5498e0-8b5a-4b09-87af-287bac8ff5bb tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:33.797077 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-8b5498e0-8b5a-4b09-87af-287bac8ff5bb tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.178710 May 23 12:39:33.797656 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 363/724] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:39:33 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:39:34.143856 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-38fca860-70d0-4533-81b8-c7838abc13e5 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:34.144488 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-38fca860-70d0-4533-81b8-c7838abc13e5 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:34.150974 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-38fca860-70d0-4533-81b8-c7838abc13e5 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:34.151431 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-38fca860-70d0-4533-81b8-c7838abc13e5 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:34.152230 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-38fca860-70d0-4533-81b8-c7838abc13e5 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:34.153239 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-38fca860-70d0-4533-81b8-c7838abc13e5 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:34.290561 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-a9214a76-0dc8-4de1-9583-7503c1208d45 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:34.290988 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-a9214a76-0dc8-4de1-9583-7503c1208d45 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 203877da-d78e-44f0-bc6a-995008fef4f7] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:34.298051 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a9214a76-0dc8-4de1-9583-7503c1208d45 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:34.298586 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a9214a76-0dc8-4de1-9583-7503c1208d45 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:34.299590 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a9214a76-0dc8-4de1-9583-7503c1208d45 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:34.300095 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a9214a76-0dc8-4de1-9583-7503c1208d45 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:34.328022 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-38fca860-70d0-4533-81b8-c7838abc13e5 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:34.340205 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-38fca860-70d0-4533-81b8-c7838abc13e5 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1519 microversion: 2.1 time: 0.200642 May 23 12:39:34.340786 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 362/725] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:34 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1519 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:39:34.386186 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.objects.instance [None req-a9214a76-0dc8-4de1-9583-7503c1208d45 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lazy-loading 'services' on Instance uuid 203877da-d78e-44f0-bc6a-995008fef4f7 {{(pid=124200) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:39:34.465470 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-a9214a76-0dc8-4de1-9583-7503c1208d45 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "DELETE /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7/os-volume_attachments/60317fbc-3c51-416e-980d-4ca8df9ca023" status: 202 len: 0 microversion: 2.1 time: 0.178288 May 23 12:39:34.466703 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 364/726] 10.222.0.16 () {58 vars in 1415 bytes} [Mon May 23 12:39:34 2022] DELETE /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7/os-volume_attachments/60317fbc-3c51-416e-980d-4ca8df9ca023 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 12:39:34.477527 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-9f0b1ce7-1ca6-45da-952d-407e778c26b0 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:34.478754 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-9f0b1ce7-1ca6-45da-952d-407e778c26b0 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 203877da-d78e-44f0-bc6a-995008fef4f7] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:34.485176 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9f0b1ce7-1ca6-45da-952d-407e778c26b0 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:34.485916 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9f0b1ce7-1ca6-45da-952d-407e778c26b0 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:34.486908 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9f0b1ce7-1ca6-45da-952d-407e778c26b0 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:34.487382 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9f0b1ce7-1ca6-45da-952d-407e778c26b0 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:34.535212 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-9f0b1ce7-1ca6-45da-952d-407e778c26b0 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063108 May 23 12:39:34.535704 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 363/727] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 12:39:34 2022] GET /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:39:34.819334 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-2c694f07-2a5e-47bb-9d1f-7a7fa72d5de4 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:34.823692 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-2c694f07-2a5e-47bb-9d1f-7a7fa72d5de4 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:34.828002 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2c694f07-2a5e-47bb-9d1f-7a7fa72d5de4 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:34.828816 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2c694f07-2a5e-47bb-9d1f-7a7fa72d5de4 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:34.829677 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2c694f07-2a5e-47bb-9d1f-7a7fa72d5de4 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:34.830120 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2c694f07-2a5e-47bb-9d1f-7a7fa72d5de4 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:34.979204 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-2c694f07-2a5e-47bb-9d1f-7a7fa72d5de4 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:34.987693 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-2c694f07-2a5e-47bb-9d1f-7a7fa72d5de4 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:34.989555 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-2c694f07-2a5e-47bb-9d1f-7a7fa72d5de4 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:34.990726 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-2c694f07-2a5e-47bb-9d1f-7a7fa72d5de4 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.177818 May 23 12:39:34.991273 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 365/728] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:39:34 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:39:35.357583 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-938c9f4c-1ea1-4e42-86b2-b66b56be6141 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:35.358113 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-938c9f4c-1ea1-4e42-86b2-b66b56be6141 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 9a267457-7f06-4312-87ce-2c47cdb2924d] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:35.358919 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-571821cd-6725-46b9-9aab-94e8b92dc720 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:35.359630 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-571821cd-6725-46b9-9aab-94e8b92dc720 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:35.365453 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-938c9f4c-1ea1-4e42-86b2-b66b56be6141 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:35.366129 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-938c9f4c-1ea1-4e42-86b2-b66b56be6141 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:35.367081 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-938c9f4c-1ea1-4e42-86b2-b66b56be6141 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:35.367566 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-571821cd-6725-46b9-9aab-94e8b92dc720 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:35.367877 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-938c9f4c-1ea1-4e42-86b2-b66b56be6141 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:35.368084 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-571821cd-6725-46b9-9aab-94e8b92dc720 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:35.369053 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-571821cd-6725-46b9-9aab-94e8b92dc720 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:35.369483 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-571821cd-6725-46b9-9aab-94e8b92dc720 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:35.424940 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-938c9f4c-1ea1-4e42-86b2-b66b56be6141 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d/os-volume_attachments/cca9080f-19bd-4249-83fe-60ffb14c6a19" status: 200 len: 194 microversion: 2.1 time: 0.069593 May 23 12:39:35.427154 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 364/729] 10.222.0.16 () {58 vars in 1412 bytes} [Mon May 23 12:39:35 2022] GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d/os-volume_attachments/cca9080f-19bd-4249-83fe-60ffb14c6a19 => generated 194 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:39:35.439887 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-6461ce03-b896-4390-b1f0-122154757283 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:35.442574 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-6461ce03-b896-4390-b1f0-122154757283 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 9a267457-7f06-4312-87ce-2c47cdb2924d] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:35.449138 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6461ce03-b896-4390-b1f0-122154757283 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:35.449593 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6461ce03-b896-4390-b1f0-122154757283 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:35.450365 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6461ce03-b896-4390-b1f0-122154757283 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:35.450807 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6461ce03-b896-4390-b1f0-122154757283 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:35.571828 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-571821cd-6725-46b9-9aab-94e8b92dc720 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:35.582489 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-571821cd-6725-46b9-9aab-94e8b92dc720 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1575 microversion: 2.1 time: 0.227955 May 23 12:39:35.586166 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 366/730] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:35 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1575 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:39:35.592678 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-bf02c667-09b3-4e9d-9936-dc802ec57408 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:35.593927 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-bf02c667-09b3-4e9d-9936-dc802ec57408 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 203877da-d78e-44f0-bc6a-995008fef4f7] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:35.601914 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-bf02c667-09b3-4e9d-9936-dc802ec57408 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:35.602506 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-bf02c667-09b3-4e9d-9936-dc802ec57408 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:35.603526 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-bf02c667-09b3-4e9d-9936-dc802ec57408 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:35.604074 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-bf02c667-09b3-4e9d-9936-dc802ec57408 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:35.607339 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.objects.instance [None req-6461ce03-b896-4390-b1f0-122154757283 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lazy-loading 'services' on Instance uuid 9a267457-7f06-4312-87ce-2c47cdb2924d {{(pid=124199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:39:35.641928 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-bf02c667-09b3-4e9d-9936-dc802ec57408 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053141 May 23 12:39:35.642568 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 367/731] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 12:39:35 2022] GET /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:39:35.878752 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-6461ce03-b896-4390-b1f0-122154757283 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d/os-volume_attachments/cca9080f-19bd-4249-83fe-60ffb14c6a19" status: 202 len: 0 microversion: 2.1 time: 0.446526 May 23 12:39:35.880387 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 365/732] 10.222.0.16 () {58 vars in 1415 bytes} [Mon May 23 12:39:35 2022] DELETE /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d/os-volume_attachments/cca9080f-19bd-4249-83fe-60ffb14c6a19 => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:39:36.008831 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-dc5cc23e-565e-4dd2-a681-3318cb196797 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:36.009557 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-dc5cc23e-565e-4dd2-a681-3318cb196797 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:36.016699 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-dc5cc23e-565e-4dd2-a681-3318cb196797 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:36.017219 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-dc5cc23e-565e-4dd2-a681-3318cb196797 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:36.018058 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-dc5cc23e-565e-4dd2-a681-3318cb196797 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:36.018558 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-dc5cc23e-565e-4dd2-a681-3318cb196797 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:36.154634 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-dc5cc23e-565e-4dd2-a681-3318cb196797 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:36.163978 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-dc5cc23e-565e-4dd2-a681-3318cb196797 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:36.165533 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-dc5cc23e-565e-4dd2-a681-3318cb196797 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:36.166690 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-dc5cc23e-565e-4dd2-a681-3318cb196797 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.161837 May 23 12:39:36.167246 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 368/733] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:39:36 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:39:36.602559 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-9fb52ba8-3825-4038-94dc-f95fc0a60f1a tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:36.603260 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-9fb52ba8-3825-4038-94dc-f95fc0a60f1a tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:36.605245 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_api:SELECT=70 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:36.611435 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9fb52ba8-3825-4038-94dc-f95fc0a60f1a tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:36.611951 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9fb52ba8-3825-4038-94dc-f95fc0a60f1a tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:36.612766 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9fb52ba8-3825-4038-94dc-f95fc0a60f1a tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:36.613202 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9fb52ba8-3825-4038-94dc-f95fc0a60f1a tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:36.654179 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-3ab0d372-ce28-40d0-a2d7-b556d843c85e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:36.655155 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-3ab0d372-ce28-40d0-a2d7-b556d843c85e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 203877da-d78e-44f0-bc6a-995008fef4f7] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:36.661392 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3ab0d372-ce28-40d0-a2d7-b556d843c85e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:36.661887 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3ab0d372-ce28-40d0-a2d7-b556d843c85e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:36.662633 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3ab0d372-ce28-40d0-a2d7-b556d843c85e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:36.663072 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3ab0d372-ce28-40d0-a2d7-b556d843c85e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:36.693048 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-3ab0d372-ce28-40d0-a2d7-b556d843c85e tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041837 May 23 12:39:36.693326 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 369/734] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 12:39:36 2022] GET /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 23 12:39:36.750325 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-449ad241-aa74-4a2c-b92e-0153012322de tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:36.750827 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-449ad241-aa74-4a2c-b92e-0153012322de tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 203877da-d78e-44f0-bc6a-995008fef4f7] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:36.751064 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9fb52ba8-3825-4038-94dc-f95fc0a60f1a tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:36.757563 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-449ad241-aa74-4a2c-b92e-0153012322de tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:36.758024 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-449ad241-aa74-4a2c-b92e-0153012322de tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:36.758810 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-449ad241-aa74-4a2c-b92e-0153012322de tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:36.759250 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-449ad241-aa74-4a2c-b92e-0153012322de tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:36.759571 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-9fb52ba8-3825-4038-94dc-f95fc0a60f1a tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1575 microversion: 2.1 time: 0.161901 May 23 12:39:36.760150 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 366/735] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:36 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:39:36.776530 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:36.788117 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-449ad241-aa74-4a2c-b92e-0153012322de tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 203877da-d78e-44f0-bc6a-995008fef4f7] Going to try to terminate instance {{(pid=124200) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 12:39:36.862671 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-449ad241-aa74-4a2c-b92e-0153012322de tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "DELETE /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7" status: 204 len: 0 microversion: 2.1 time: 0.115799 May 23 12:39:36.863196 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 370/736] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 12:39:36 2022] DELETE /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 12:39:36.873279 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-693ee473-5a90-455f-869c-dc9d1840c5a5 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:36.873893 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-693ee473-5a90-455f-869c-dc9d1840c5a5 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 203877da-d78e-44f0-bc6a-995008fef4f7] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:36.882982 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-693ee473-5a90-455f-869c-dc9d1840c5a5 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:36.883526 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-693ee473-5a90-455f-869c-dc9d1840c5a5 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:36.884455 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-693ee473-5a90-455f-869c-dc9d1840c5a5 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:36.885206 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-693ee473-5a90-455f-869c-dc9d1840c5a5 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:37.036735 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-693ee473-5a90-455f-869c-dc9d1840c5a5 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:37.044640 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-693ee473-5a90-455f-869c-dc9d1840c5a5 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7" status: 200 len: 1682 microversion: 2.1 time: 0.176123 May 23 12:39:37.045590 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 367/737] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:36 2022] GET /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7 => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:39:37.066778 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-881eb554-3354-4b4e-bab5-50ba04ba79e4 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:37.068435 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-881eb554-3354-4b4e-bab5-50ba04ba79e4 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 9a267457-7f06-4312-87ce-2c47cdb2924d] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:37.074812 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-881eb554-3354-4b4e-bab5-50ba04ba79e4 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:37.075265 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-881eb554-3354-4b4e-bab5-50ba04ba79e4 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:37.076035 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-881eb554-3354-4b4e-bab5-50ba04ba79e4 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:37.076509 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-881eb554-3354-4b4e-bab5-50ba04ba79e4 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:37.106185 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-881eb554-3354-4b4e-bab5-50ba04ba79e4 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043767 May 23 12:39:37.106749 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 371/738] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 12:39:37 2022] GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 12:39:37.185482 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-4f8910ef-4e9c-4aeb-a045-545135d9af07 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:37.186242 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-4f8910ef-4e9c-4aeb-a045-545135d9af07 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:37.193366 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4f8910ef-4e9c-4aeb-a045-545135d9af07 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:37.193826 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4f8910ef-4e9c-4aeb-a045-545135d9af07 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:37.194682 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4f8910ef-4e9c-4aeb-a045-545135d9af07 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:37.195121 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4f8910ef-4e9c-4aeb-a045-545135d9af07 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:37.222019 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-a9fb53bc-5f19-4d8f-80f1-2498c51157a4 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:37.222949 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-a9fb53bc-5f19-4d8f-80f1-2498c51157a4 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 9a267457-7f06-4312-87ce-2c47cdb2924d] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:37.231520 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a9fb53bc-5f19-4d8f-80f1-2498c51157a4 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:37.232210 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a9fb53bc-5f19-4d8f-80f1-2498c51157a4 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:37.233443 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a9fb53bc-5f19-4d8f-80f1-2498c51157a4 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:37.234204 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a9fb53bc-5f19-4d8f-80f1-2498c51157a4 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:37.269551 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-a9fb53bc-5f19-4d8f-80f1-2498c51157a4 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052072 May 23 12:39:37.270151 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 372/739] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 12:39:37 2022] GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 23 12:39:37.342371 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-9fd1951c-c845-43ba-9aea-79d40f8ffd0f tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:37.342878 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-9fd1951c-c845-43ba-9aea-79d40f8ffd0f tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 9a267457-7f06-4312-87ce-2c47cdb2924d] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:37.344122 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-4f8910ef-4e9c-4aeb-a045-545135d9af07 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:37.349853 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9fd1951c-c845-43ba-9aea-79d40f8ffd0f tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:37.350836 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9fd1951c-c845-43ba-9aea-79d40f8ffd0f tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:37.351797 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9fd1951c-c845-43ba-9aea-79d40f8ffd0f tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:37.352438 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9fd1951c-c845-43ba-9aea-79d40f8ffd0f tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:37.353758 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-4f8910ef-4e9c-4aeb-a045-545135d9af07 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:37.355273 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-4f8910ef-4e9c-4aeb-a045-545135d9af07 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:37.356474 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-4f8910ef-4e9c-4aeb-a045-545135d9af07 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.175040 May 23 12:39:37.357063 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 368/740] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:39:37 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:39:37.379608 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-9fd1951c-c845-43ba-9aea-79d40f8ffd0f tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 9a267457-7f06-4312-87ce-2c47cdb2924d] Going to try to terminate instance {{(pid=124200) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 12:39:37.456544 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-9fd1951c-c845-43ba-9aea-79d40f8ffd0f tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d" status: 204 len: 0 microversion: 2.1 time: 0.118483 May 23 12:39:37.457119 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 373/741] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 12:39:37 2022] DELETE /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 12:39:37.465834 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-9fafccec-cd90-4709-bc1e-9522ccfa7526 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:37.466441 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-9fafccec-cd90-4709-bc1e-9522ccfa7526 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 9a267457-7f06-4312-87ce-2c47cdb2924d] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:37.472621 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9fafccec-cd90-4709-bc1e-9522ccfa7526 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:37.473064 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9fafccec-cd90-4709-bc1e-9522ccfa7526 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:37.474536 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9fafccec-cd90-4709-bc1e-9522ccfa7526 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:37.474979 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9fafccec-cd90-4709-bc1e-9522ccfa7526 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:37.617070 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9fafccec-cd90-4709-bc1e-9522ccfa7526 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:37.624496 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-9fafccec-cd90-4709-bc1e-9522ccfa7526 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d" status: 200 len: 1672 microversion: 2.1 time: 0.162614 May 23 12:39:37.625061 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 369/742] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:37 2022] GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d => generated 1672 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:39:37.777797 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-ed12897f-fadb-43c3-8226-185ec58e0756 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:37.778503 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-ed12897f-fadb-43c3-8226-185ec58e0756 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:37.784505 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ed12897f-fadb-43c3-8226-185ec58e0756 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:37.784958 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ed12897f-fadb-43c3-8226-185ec58e0756 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:37.785736 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ed12897f-fadb-43c3-8226-185ec58e0756 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:37.786876 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ed12897f-fadb-43c3-8226-185ec58e0756 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:37.921701 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-ed12897f-fadb-43c3-8226-185ec58e0756 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:37.929682 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-ed12897f-fadb-43c3-8226-185ec58e0756 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1575 microversion: 2.1 time: 0.156101 May 23 12:39:37.930252 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 374/743] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:37 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:39:38.062472 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-fd474442-1737-4b3d-9b23-3a3002bf10c7 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:38.063087 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-fd474442-1737-4b3d-9b23-3a3002bf10c7 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 203877da-d78e-44f0-bc6a-995008fef4f7] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:38.069720 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fd474442-1737-4b3d-9b23-3a3002bf10c7 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:38.070172 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fd474442-1737-4b3d-9b23-3a3002bf10c7 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:38.070939 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fd474442-1737-4b3d-9b23-3a3002bf10c7 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:38.071378 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fd474442-1737-4b3d-9b23-3a3002bf10c7 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:38.203094 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-fd474442-1737-4b3d-9b23-3a3002bf10c7 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:38.211689 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-fd474442-1737-4b3d-9b23-3a3002bf10c7 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7" status: 200 len: 1682 microversion: 2.1 time: 0.153066 May 23 12:39:38.212264 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 370/744] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:38 2022] GET /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:39:38.375788 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-ad2ba792-e90c-4c14-8af0-fa666964cb21 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:38.376597 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-ad2ba792-e90c-4c14-8af0-fa666964cb21 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:38.383996 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ad2ba792-e90c-4c14-8af0-fa666964cb21 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:38.384478 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ad2ba792-e90c-4c14-8af0-fa666964cb21 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:38.385257 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ad2ba792-e90c-4c14-8af0-fa666964cb21 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:38.385697 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ad2ba792-e90c-4c14-8af0-fa666964cb21 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:38.516188 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-ad2ba792-e90c-4c14-8af0-fa666964cb21 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:38.524120 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-ad2ba792-e90c-4c14-8af0-fa666964cb21 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:38.525657 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-ad2ba792-e90c-4c14-8af0-fa666964cb21 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:38.526905 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-ad2ba792-e90c-4c14-8af0-fa666964cb21 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.155007 May 23 12:39:38.527453 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 375/745] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:39:38 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:39:38.642363 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-dc56f383-3a13-4bf4-81ab-b47fa32e087c tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:38.642899 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-dc56f383-3a13-4bf4-81ab-b47fa32e087c tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 9a267457-7f06-4312-87ce-2c47cdb2924d] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:38.650779 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dc56f383-3a13-4bf4-81ab-b47fa32e087c tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:38.651228 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dc56f383-3a13-4bf4-81ab-b47fa32e087c tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:38.652181 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dc56f383-3a13-4bf4-81ab-b47fa32e087c tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:38.652634 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dc56f383-3a13-4bf4-81ab-b47fa32e087c tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:38.782097 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-dc56f383-3a13-4bf4-81ab-b47fa32e087c tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:38.790445 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-dc56f383-3a13-4bf4-81ab-b47fa32e087c tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d" status: 200 len: 1672 microversion: 2.1 time: 0.152048 May 23 12:39:38.791019 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 371/746] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:38 2022] GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:39:38.946233 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-01bf8e9e-7dcd-46e6-9d69-8f9bc5434e68 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:38.946841 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-01bf8e9e-7dcd-46e6-9d69-8f9bc5434e68 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:38.952762 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-01bf8e9e-7dcd-46e6-9d69-8f9bc5434e68 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:38.953215 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-01bf8e9e-7dcd-46e6-9d69-8f9bc5434e68 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:38.954244 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-01bf8e9e-7dcd-46e6-9d69-8f9bc5434e68 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:38.954684 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-01bf8e9e-7dcd-46e6-9d69-8f9bc5434e68 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:39.096037 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-01bf8e9e-7dcd-46e6-9d69-8f9bc5434e68 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:39.104298 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-01bf8e9e-7dcd-46e6-9d69-8f9bc5434e68 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1575 microversion: 2.1 time: 0.161924 May 23 12:39:39.105245 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 376/747] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:38 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:39:39.229257 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-15f272f5-a4ff-4cfc-b81b-85704355a3e0 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:39.229902 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-15f272f5-a4ff-4cfc-b81b-85704355a3e0 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 203877da-d78e-44f0-bc6a-995008fef4f7] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:39.235795 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-15f272f5-a4ff-4cfc-b81b-85704355a3e0 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:39.236275 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-15f272f5-a4ff-4cfc-b81b-85704355a3e0 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:39.237114 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-15f272f5-a4ff-4cfc-b81b-85704355a3e0 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:39.237554 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-15f272f5-a4ff-4cfc-b81b-85704355a3e0 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:39.421415 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-15f272f5-a4ff-4cfc-b81b-85704355a3e0 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:39.429174 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-15f272f5-a4ff-4cfc-b81b-85704355a3e0 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7" status: 200 len: 1682 microversion: 2.1 time: 0.203634 May 23 12:39:39.429746 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 372/748] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:39 2022] GET /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7 => generated 1682 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:39:39.545200 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-39d04b12-c13b-418e-b9ec-35013a7a19e6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:39.545819 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-39d04b12-c13b-418e-b9ec-35013a7a19e6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:39.552561 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-39d04b12-c13b-418e-b9ec-35013a7a19e6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:39.553108 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-39d04b12-c13b-418e-b9ec-35013a7a19e6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:39.554892 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-39d04b12-c13b-418e-b9ec-35013a7a19e6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:39.554892 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-39d04b12-c13b-418e-b9ec-35013a7a19e6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:39.691848 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-39d04b12-c13b-418e-b9ec-35013a7a19e6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:39.701129 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-39d04b12-c13b-418e-b9ec-35013a7a19e6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:39.702679 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-39d04b12-c13b-418e-b9ec-35013a7a19e6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:39.704281 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-39d04b12-c13b-418e-b9ec-35013a7a19e6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.163052 May 23 12:39:39.704852 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 377/749] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:39:39 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:39:39.808966 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-35efa3da-14a8-4de8-bb04-be3afe50d299 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:39.809689 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-35efa3da-14a8-4de8-bb04-be3afe50d299 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 9a267457-7f06-4312-87ce-2c47cdb2924d] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:39.816960 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-35efa3da-14a8-4de8-bb04-be3afe50d299 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:39.817428 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-35efa3da-14a8-4de8-bb04-be3afe50d299 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:39.818186 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-35efa3da-14a8-4de8-bb04-be3afe50d299 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:39.818627 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-35efa3da-14a8-4de8-bb04-be3afe50d299 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:39.837107 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:39.963899 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-35efa3da-14a8-4de8-bb04-be3afe50d299 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:39.971454 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-35efa3da-14a8-4de8-bb04-be3afe50d299 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d" status: 200 len: 1672 microversion: 2.1 time: 0.166678 May 23 12:39:39.972128 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 373/750] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:39 2022] GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d => generated 1672 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:39:40.122288 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-5037887b-bf46-46d5-9c2c-7558cf72e19e tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:40.123134 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-5037887b-bf46-46d5-9c2c-7558cf72e19e tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:40.130509 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5037887b-bf46-46d5-9c2c-7558cf72e19e tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:40.131377 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5037887b-bf46-46d5-9c2c-7558cf72e19e tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:40.132467 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5037887b-bf46-46d5-9c2c-7558cf72e19e tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:40.133194 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5037887b-bf46-46d5-9c2c-7558cf72e19e tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:40.329639 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-5037887b-bf46-46d5-9c2c-7558cf72e19e tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:40.337299 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-5037887b-bf46-46d5-9c2c-7558cf72e19e tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1575 microversion: 2.1 time: 0.218953 May 23 12:39:40.337869 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 378/751] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:40 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1575 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:39:40.447007 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-48342afe-7386-43e3-8b96-ad009d820a93 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:40.448057 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-48342afe-7386-43e3-8b96-ad009d820a93 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 203877da-d78e-44f0-bc6a-995008fef4f7] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:40.454619 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-48342afe-7386-43e3-8b96-ad009d820a93 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:40.455361 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-48342afe-7386-43e3-8b96-ad009d820a93 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:40.456693 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-48342afe-7386-43e3-8b96-ad009d820a93 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:40.457296 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-48342afe-7386-43e3-8b96-ad009d820a93 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:40.690018 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-48342afe-7386-43e3-8b96-ad009d820a93 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:40.706314 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-48342afe-7386-43e3-8b96-ad009d820a93 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7" status: 200 len: 1682 microversion: 2.1 time: 0.261700 May 23 12:39:40.708081 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 374/752] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:40 2022] GET /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7 => generated 1682 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:39:40.723236 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-12422455-2c92-469c-808e-e1f80bb8a1e7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:40.723932 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-12422455-2c92-469c-808e-e1f80bb8a1e7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:40.727178 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:40.734014 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-12422455-2c92-469c-808e-e1f80bb8a1e7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:40.734932 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-12422455-2c92-469c-808e-e1f80bb8a1e7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:40.735981 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-12422455-2c92-469c-808e-e1f80bb8a1e7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:40.736747 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-12422455-2c92-469c-808e-e1f80bb8a1e7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:40.989324 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-462b1c77-ed6a-4df0-b8a2-68745a5a9df9 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:40.990700 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-462b1c77-ed6a-4df0-b8a2-68745a5a9df9 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 9a267457-7f06-4312-87ce-2c47cdb2924d] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:40.998679 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-462b1c77-ed6a-4df0-b8a2-68745a5a9df9 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:40.999139 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-462b1c77-ed6a-4df0-b8a2-68745a5a9df9 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:41.000324 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-462b1c77-ed6a-4df0-b8a2-68745a5a9df9 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:41.000990 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-462b1c77-ed6a-4df0-b8a2-68745a5a9df9 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:41.326772 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-12422455-2c92-469c-808e-e1f80bb8a1e7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:41.340191 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-12422455-2c92-469c-808e-e1f80bb8a1e7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:41.343273 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-12422455-2c92-469c-808e-e1f80bb8a1e7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:41.345141 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-12422455-2c92-469c-808e-e1f80bb8a1e7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.626111 May 23 12:39:41.383187 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 379/753] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:39:40 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:39:41.389692 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-a0a8d75f-488c-4e96-9b2f-09b3c977417d req-3a65878d-6663-4094-a410-cd51a5b4dff6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "203877da-d78e-44f0-bc6a-995008fef4f7", "name": "network-vif-deleted", "tag": "ffc6e408-2088-45a7-824d-4afc170af6a4"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:39:41.418233 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-462b1c77-ed6a-4df0-b8a2-68745a5a9df9 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:41.424015 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-a0a8d75f-488c-4e96-9b2f-09b3c977417d req-3a65878d-6663-4094-a410-cd51a5b4dff6 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:41.425651 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-462b1c77-ed6a-4df0-b8a2-68745a5a9df9 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d" status: 200 len: 1672 microversion: 2.1 time: 0.440235 May 23 12:39:41.426280 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 375/754] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:40 2022] GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d => generated 1672 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:39:41.436588 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-a0a8d75f-488c-4e96-9b2f-09b3c977417d req-3a65878d-6663-4094-a410-cd51a5b4dff6 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:41.436798 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-adc7b554-4ed5-463e-acde-03b825b9c87f tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:41.436974 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-adc7b554-4ed5-463e-acde-03b825b9c87f tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:41.454722 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-adc7b554-4ed5-463e-acde-03b825b9c87f tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:41.457274 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-adc7b554-4ed5-463e-acde-03b825b9c87f tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:41.459930 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-adc7b554-4ed5-463e-acde-03b825b9c87f tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:41.463287 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-adc7b554-4ed5-463e-acde-03b825b9c87f tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:41.468153 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-a0a8d75f-488c-4e96-9b2f-09b3c977417d req-3a65878d-6663-4094-a410-cd51a5b4dff6 service nova] Creating event network-vif-deleted:ffc6e408-2088-45a7-824d-4afc170af6a4 for instance 203877da-d78e-44f0-bc6a-995008fef4f7 on hv-cinder-83699 May 23 12:39:41.481031 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-a0a8d75f-488c-4e96-9b2f-09b3c977417d req-3a65878d-6663-4094-a410-cd51a5b4dff6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090804 May 23 12:39:41.484365 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 380/755] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:39:41.725388 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-070907d2-b13c-4130-b369-775e3669d3ab tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:41.726087 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-070907d2-b13c-4130-b369-775e3669d3ab tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 203877da-d78e-44f0-bc6a-995008fef4f7] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:41.738583 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-070907d2-b13c-4130-b369-775e3669d3ab tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:41.741824 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-070907d2-b13c-4130-b369-775e3669d3ab tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:41.742729 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-070907d2-b13c-4130-b369-775e3669d3ab tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:41.745813 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-070907d2-b13c-4130-b369-775e3669d3ab tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:41.798904 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-adc7b554-4ed5-463e-acde-03b825b9c87f tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:41.806329 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-070907d2-b13c-4130-b369-775e3669d3ab tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:41.807030 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-070907d2-b13c-4130-b369-775e3669d3ab tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:41.807684 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.objects.instance [None req-070907d2-b13c-4130-b369-775e3669d3ab tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lazy-loading 'fault' on Instance uuid 203877da-d78e-44f0-bc6a-995008fef4f7 {{(pid=124200) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:39:41.812645 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-adc7b554-4ed5-463e-acde-03b825b9c87f tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1575 microversion: 2.1 time: 0.384973 May 23 12:39:41.813848 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 376/756] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:41 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1575 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:39:41.907612 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-070907d2-b13c-4130-b369-775e3669d3ab tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef222fe025534a9e942f8c5c4ed1e3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da82f9c566664cb1a974cf0d1bf1b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:41.916191 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-070907d2-b13c-4130-b369-775e3669d3ab tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7" status: 200 len: 1332 microversion: 2.1 time: 0.195607 May 23 12:39:41.925631 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 381/757] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:41 2022] GET /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7 => generated 1332 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:39:42.363438 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-58d171e8-3f02-4d08-8dc7-66f58a6496b3 req-a7c04eb1-24e3-47fe-bdce-fcd3029cd0a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a267457-7f06-4312-87ce-2c47cdb2924d", "name": "network-vif-deleted", "tag": "b8447d6b-c07d-4b91-8b57-270b92719707"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:39:42.367367 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-75e6db33-08e1-4181-bee4-3e749f5b796d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:42.368744 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-75e6db33-08e1-4181-bee4-3e749f5b796d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:42.376434 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-75e6db33-08e1-4181-bee4-3e749f5b796d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:42.376905 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-75e6db33-08e1-4181-bee4-3e749f5b796d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:42.377922 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-75e6db33-08e1-4181-bee4-3e749f5b796d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:42.378519 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-75e6db33-08e1-4181-bee4-3e749f5b796d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:42.385922 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-58d171e8-3f02-4d08-8dc7-66f58a6496b3 req-a7c04eb1-24e3-47fe-bdce-fcd3029cd0a6 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:42.386594 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-58d171e8-3f02-4d08-8dc7-66f58a6496b3 req-a7c04eb1-24e3-47fe-bdce-fcd3029cd0a6 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:42.419763 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-58d171e8-3f02-4d08-8dc7-66f58a6496b3 req-a7c04eb1-24e3-47fe-bdce-fcd3029cd0a6 service nova] Creating event network-vif-deleted:b8447d6b-c07d-4b91-8b57-270b92719707 for instance 9a267457-7f06-4312-87ce-2c47cdb2924d on hv-cinder-83699 May 23 12:39:42.444503 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-58d171e8-3f02-4d08-8dc7-66f58a6496b3 req-a7c04eb1-24e3-47fe-bdce-fcd3029cd0a6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.370295 May 23 12:39:42.445927 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 377/758] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:39:42.451720 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f8eb04fe-45bc-4a32-865d-85abb5e71e3e tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:42.452653 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-f8eb04fe-45bc-4a32-865d-85abb5e71e3e tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 9a267457-7f06-4312-87ce-2c47cdb2924d] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:42.462952 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f8eb04fe-45bc-4a32-865d-85abb5e71e3e tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:42.463585 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f8eb04fe-45bc-4a32-865d-85abb5e71e3e tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:42.464891 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f8eb04fe-45bc-4a32-865d-85abb5e71e3e tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:42.465491 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f8eb04fe-45bc-4a32-865d-85abb5e71e3e tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:42.644269 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f8eb04fe-45bc-4a32-865d-85abb5e71e3e tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d3e22beff44f7bbc3103fd75a35b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736376830ed340b2aa62c455c134c4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:42.652833 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f8eb04fe-45bc-4a32-865d-85abb5e71e3e tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d" status: 200 len: 1322 microversion: 2.1 time: 0.205333 May 23 12:39:42.653565 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 378/759] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:42 2022] GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:39:42.728400 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-75e6db33-08e1-4181-bee4-3e749f5b796d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:42.743512 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-75e6db33-08e1-4181-bee4-3e749f5b796d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:42.745907 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-75e6db33-08e1-4181-bee4-3e749f5b796d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:42.747703 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-75e6db33-08e1-4181-bee4-3e749f5b796d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.386626 May 23 12:39:42.749485 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 382/760] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:39:42 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:39:42.833752 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-503ef25a-696c-46e7-9e73-24fe99d9d997 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:42.834496 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-503ef25a-696c-46e7-9e73-24fe99d9d997 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:42.840746 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-503ef25a-696c-46e7-9e73-24fe99d9d997 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:42.841488 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-503ef25a-696c-46e7-9e73-24fe99d9d997 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:42.842813 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-503ef25a-696c-46e7-9e73-24fe99d9d997 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:42.842973 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-503ef25a-696c-46e7-9e73-24fe99d9d997 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:42.934292 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-99d16794-f29b-431b-9392-ba9e25478a2f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:42.934915 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-99d16794-f29b-431b-9392-ba9e25478a2f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 203877da-d78e-44f0-bc6a-995008fef4f7] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:42.941649 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-99d16794-f29b-431b-9392-ba9e25478a2f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:42.942399 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-99d16794-f29b-431b-9392-ba9e25478a2f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:42.943200 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-99d16794-f29b-431b-9392-ba9e25478a2f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:42.943799 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-99d16794-f29b-431b-9392-ba9e25478a2f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:42.964575 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.wsgi [None req-99d16794-f29b-431b-9392-ba9e25478a2f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] HTTP exception thrown: Instance 203877da-d78e-44f0-bc6a-995008fef4f7 could not be found. May 23 12:39:42.966815 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-99d16794-f29b-431b-9392-ba9e25478a2f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Request method failure captured: May 23 12:39:42.966815 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: request: GET /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7 HTTP/1.1 May 23 12:39:42.966815 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept: application/json May 23 12:39:42.966815 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept-Encoding: identity May 23 12:39:42.966815 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Connection: close May 23 12:39:42.966815 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Length: 0 May 23 12:39:42.966815 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Type: application/json May 23 12:39:42.966815 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Host: 10.222.0.16 May 23 12:39:42.966815 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Openstack-System-Scope: None May 23 12:39:42.966815 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: User-Agent: python-urllib3/1.26.9 May 23 12:39:42.966815 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Auth-Token: gAAAAABii38ZU7Vwsw5AAU8G7deCk06Tjsg_k90-PVfeWrd3aNHg-oGVBFwUfnF7AZgHGAQrHmO4XQOE1Bz6uWE6i2CAUoXJsEuLNZGXvkqTPiv0H7N4ZSkFEsbSkgm2LM1J6iSbSGefN_01pdctKfH8BgGpUswrmPhK0nZLP7jsVPYKp_z7ea8 May 23 12:39:42.966815 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Id: None May 23 12:39:42.966815 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Name: None May 23 12:39:42.966815 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Identity-Status: Confirmed May 23 12:39:42.966815 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Is-Admin-Project: True May 23 12:39:42.966815 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Id: default May 23 12:39:42.966815 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Name: Default May 23 12:39:42.966815 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Id: da82f9c566664cb1a974cf0d1bf1b09d May 23 12:39:42.966815 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Name: tempest-AttachVolumeNegativeTest-2053273606 May 23 12:39:42.966815 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Role: member,reader May 23 12:39:42.966815 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Roles: member,reader May 23 12:39:42.968543 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da82f9c566664cb1a974cf0d1bf1b09d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da82f9c566664cb1a974cf0d1bf1b09d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da82f9c566664cb1a974cf0d1bf1b09d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da82f9c566664cb1a974cf0d1bf1b09d"}]}] May 23 12:39:42.968543 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant: tempest-AttachVolumeNegativeTest-2053273606 May 23 12:39:42.968543 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Id: da82f9c566664cb1a974cf0d1bf1b09d May 23 12:39:42.968543 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2053273606 May 23 12:39:42.968543 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User: tempest-AttachVolumeNegativeTest-2053273606-project May 23 12:39:42.968543 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Id: default May 23 12:39:42.968543 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Name: Default May 23 12:39:42.968543 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Id: ef222fe025534a9e942f8c5c4ed1e3e7 May 23 12:39:42.968543 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Name: tempest-AttachVolumeNegativeTest-2053273606-project May 23 12:39:42.968543 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: method: > May 23 12:39:42.968543 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: exception: Instance 203877da-d78e-44f0-bc6a-995008fef4f7 could not be found. May 23 12:39:42.968543 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: action_args: {'id': '203877da-d78e-44f0-bc6a-995008fef4f7'} May 23 12:39:42.969389 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:39:42.969389 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:39:42.969389 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:39:42.969389 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:39:42.969389 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:39:42.969389 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:39:42.969389 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:39:42.969389 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:39:42.969389 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:39:42.969389 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:39:42.969389 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 203877da-d78e-44f0-bc6a-995008fef4f7 could not be found. May 23 12:39:42.969389 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:42.969389 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:39:42.969389 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:42.969389 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:39:42.969389 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:39:42.969389 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:39:42.969389 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:39:42.969389 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:39:42.969389 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:39:42.972630 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:39:42.972630 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:39:42.972630 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:39:42.972630 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:39:42.972630 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:39:42.972630 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:39:42.972630 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:39:42.972630 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 203877da-d78e-44f0-bc6a-995008fef4f7 could not be found. May 23 12:39:42.972630 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:42.972630 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:39:42.972630 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:42.972630 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:39:42.972630 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:39:42.972630 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:39:42.972630 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:39:42.972630 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:39:42.972630 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 203877da-d78e-44f0-bc6a-995008fef4f7 could not be found. May 23 12:39:42.972630 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:42.974700 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-99d16794-f29b-431b-9392-ba9e25478a2f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Returning 404 to user: Instance 203877da-d78e-44f0-bc6a-995008fef4f7 could not be found. {{(pid=124200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:39:42.974700 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-99d16794-f29b-431b-9392-ba9e25478a2f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7" status: 404 len: 111 microversion: 2.1 time: 0.038912 May 23 12:39:42.974700 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 383/761] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:42 2022] GET /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:39:42.978638 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-8738d871-82d3-4279-99ad-9fc1f97ce5c4 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '.version_select at 0x7f095ca521f0>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:43.001321 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-8738d871-82d3-4279-99ad-9fc1f97ce5c4 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2127905694" status: 202 len: 0 microversion: 2.1 time: 0.026672 May 23 12:39:43.005727 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 384/762] 10.222.0.16 () {58 vars in 1220 bytes} [Mon May 23 12:39:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2127905694 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:39:43.246210 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-503ef25a-696c-46e7-9e73-24fe99d9d997 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:43.253892 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-503ef25a-696c-46e7-9e73-24fe99d9d997 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1575 microversion: 2.1 time: 0.426769 May 23 12:39:43.255763 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 379/763] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:42 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1575 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:39:43.671182 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-6c96a7be-1b18-4f04-aa41-bcb431dbfedb tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:43.672010 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-6c96a7be-1b18-4f04-aa41-bcb431dbfedb tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 9a267457-7f06-4312-87ce-2c47cdb2924d] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:43.685275 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6c96a7be-1b18-4f04-aa41-bcb431dbfedb tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:43.685715 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6c96a7be-1b18-4f04-aa41-bcb431dbfedb tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:43.686582 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6c96a7be-1b18-4f04-aa41-bcb431dbfedb tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:43.687386 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6c96a7be-1b18-4f04-aa41-bcb431dbfedb tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:43.709191 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.wsgi [None req-6c96a7be-1b18-4f04-aa41-bcb431dbfedb tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] HTTP exception thrown: Instance 9a267457-7f06-4312-87ce-2c47cdb2924d could not be found. May 23 12:39:43.710809 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-6c96a7be-1b18-4f04-aa41-bcb431dbfedb tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Request method failure captured: May 23 12:39:43.710809 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: request: GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d HTTP/1.1 May 23 12:39:43.710809 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept: application/json May 23 12:39:43.710809 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept-Encoding: identity May 23 12:39:43.710809 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Connection: close May 23 12:39:43.710809 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Length: 0 May 23 12:39:43.710809 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Type: application/json May 23 12:39:43.710809 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Host: 10.222.0.16 May 23 12:39:43.710809 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Openstack-System-Scope: None May 23 12:39:43.710809 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: User-Agent: python-urllib3/1.26.9 May 23 12:39:43.710809 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Auth-Token: gAAAAABii38aXdKGMOEVZ2spEcutkaQ86Yc_NLCUbMHOXXQH8Bm8w2vzfmASCK0LDJk-Hh7hHX90aFsUsBLdB-dTHGD9i7_ibWA6MXmnHMUtHbJnyrAFrC09GqDvy-mdyJpa7IcS6ayZUQlOhJ_hIkrPICcxCi1iE5fq6VI-EmRi6tTe7pQxsRo May 23 12:39:43.710809 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Id: None May 23 12:39:43.710809 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Name: None May 23 12:39:43.710809 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Identity-Status: Confirmed May 23 12:39:43.710809 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Is-Admin-Project: True May 23 12:39:43.710809 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Id: default May 23 12:39:43.710809 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Name: Default May 23 12:39:43.710809 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Id: 736376830ed340b2aa62c455c134c4e2 May 23 12:39:43.710809 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Name: tempest-AttachVolumeTestJSON-2113320926 May 23 12:39:43.710809 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Role: member,reader May 23 12:39:43.710809 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Roles: member,reader May 23 12:39:43.712123 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/736376830ed340b2aa62c455c134c4e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/736376830ed340b2aa62c455c134c4e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_736376830ed340b2aa62c455c134c4e2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/736376830ed340b2aa62c455c134c4e2"}]}] May 23 12:39:43.712123 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant: tempest-AttachVolumeTestJSON-2113320926 May 23 12:39:43.712123 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Id: 736376830ed340b2aa62c455c134c4e2 May 23 12:39:43.712123 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2113320926 May 23 12:39:43.712123 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User: tempest-AttachVolumeTestJSON-2113320926-project May 23 12:39:43.712123 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Id: default May 23 12:39:43.712123 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Name: Default May 23 12:39:43.712123 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Id: 771d3e22beff44f7bbc3103fd75a35b4 May 23 12:39:43.712123 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Name: tempest-AttachVolumeTestJSON-2113320926-project May 23 12:39:43.712123 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: method: > May 23 12:39:43.712123 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: exception: Instance 9a267457-7f06-4312-87ce-2c47cdb2924d could not be found. May 23 12:39:43.712123 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: action_args: {'id': '9a267457-7f06-4312-87ce-2c47cdb2924d'} May 23 12:39:43.712968 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:39:43.712968 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:39:43.712968 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:39:43.712968 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:39:43.712968 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:39:43.712968 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:39:43.712968 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:39:43.712968 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:39:43.712968 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:39:43.712968 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:39:43.712968 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a267457-7f06-4312-87ce-2c47cdb2924d could not be found. May 23 12:39:43.712968 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:43.712968 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:39:43.712968 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:43.712968 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:39:43.712968 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:39:43.712968 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:39:43.712968 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:39:43.712968 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:39:43.712968 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:39:43.714275 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:39:43.714275 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:39:43.714275 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:39:43.714275 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:39:43.714275 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:39:43.714275 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:39:43.714275 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:39:43.714275 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a267457-7f06-4312-87ce-2c47cdb2924d could not be found. May 23 12:39:43.714275 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:43.714275 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:39:43.714275 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:43.714275 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:39:43.714275 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:39:43.714275 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:39:43.714275 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:39:43.714275 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:39:43.714275 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a267457-7f06-4312-87ce-2c47cdb2924d could not be found. May 23 12:39:43.714275 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:43.716290 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-6c96a7be-1b18-4f04-aa41-bcb431dbfedb tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Returning 404 to user: Instance 9a267457-7f06-4312-87ce-2c47cdb2924d could not be found. {{(pid=124200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:39:43.718602 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-6c96a7be-1b18-4f04-aa41-bcb431dbfedb tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d" status: 404 len: 111 microversion: 2.1 time: 0.050903 May 23 12:39:43.719323 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 385/764] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:43 2022] GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:39:43.727642 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-24b30fcf-bf1e-472f-b8f6-fbb6aa11ae5b tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '.version_select at 0x7f095d068280>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:43.751290 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-24b30fcf-bf1e-472f-b8f6-fbb6aa11ae5b tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1672508328" status: 202 len: 0 microversion: 2.1 time: 0.027295 May 23 12:39:43.752396 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 380/765] 10.222.0.16 () {58 vars in 1220 bytes} [Mon May 23 12:39:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1672508328 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:39:43.767883 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-801545fa-dbf0-4c5d-bb60-936681bb1d27 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:43.768672 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-801545fa-dbf0-4c5d-bb60-936681bb1d27 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:43.776589 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-801545fa-dbf0-4c5d-bb60-936681bb1d27 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:43.777115 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-801545fa-dbf0-4c5d-bb60-936681bb1d27 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:43.777899 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-801545fa-dbf0-4c5d-bb60-936681bb1d27 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:43.778681 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-801545fa-dbf0-4c5d-bb60-936681bb1d27 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:43.802167 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:43.999736 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-801545fa-dbf0-4c5d-bb60-936681bb1d27 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:44.011730 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-801545fa-dbf0-4c5d-bb60-936681bb1d27 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:44.014225 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-801545fa-dbf0-4c5d-bb60-936681bb1d27 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:44.015467 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-801545fa-dbf0-4c5d-bb60-936681bb1d27 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.252581 May 23 12:39:44.016247 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 386/766] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:39:43 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:39:44.273801 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-e3fac23b-2a14-42bc-8c64-f64ef7c7598f tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:44.274988 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-e3fac23b-2a14-42bc-8c64-f64ef7c7598f tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:44.281554 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e3fac23b-2a14-42bc-8c64-f64ef7c7598f tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:44.282448 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e3fac23b-2a14-42bc-8c64-f64ef7c7598f tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:44.283471 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e3fac23b-2a14-42bc-8c64-f64ef7c7598f tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:44.283912 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e3fac23b-2a14-42bc-8c64-f64ef7c7598f tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:44.484853 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-e3fac23b-2a14-42bc-8c64-f64ef7c7598f tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:44.493722 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-e3fac23b-2a14-42bc-8c64-f64ef7c7598f tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1575 microversion: 2.1 time: 0.224685 May 23 12:39:44.494899 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 381/767] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:44 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1575 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:39:44.986980 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-4bff701f-6038-4656-bf19-8a5eb0128bb5 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:44.988364 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-4bff701f-6038-4656-bf19-8a5eb0128bb5 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 203877da-d78e-44f0-bc6a-995008fef4f7] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:44.995816 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4bff701f-6038-4656-bf19-8a5eb0128bb5 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:44.996541 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4bff701f-6038-4656-bf19-8a5eb0128bb5 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:44.997672 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4bff701f-6038-4656-bf19-8a5eb0128bb5 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:44.998506 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4bff701f-6038-4656-bf19-8a5eb0128bb5 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:45.013697 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.wsgi [None req-4bff701f-6038-4656-bf19-8a5eb0128bb5 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] HTTP exception thrown: Instance 203877da-d78e-44f0-bc6a-995008fef4f7 could not be found. May 23 12:39:45.015587 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-4bff701f-6038-4656-bf19-8a5eb0128bb5 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Request method failure captured: May 23 12:39:45.015587 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: request: DELETE /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7 HTTP/1.1 May 23 12:39:45.015587 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept: application/json May 23 12:39:45.015587 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept-Encoding: identity May 23 12:39:45.015587 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Connection: close May 23 12:39:45.015587 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Length: 0 May 23 12:39:45.015587 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Type: application/json May 23 12:39:45.015587 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Host: 10.222.0.16 May 23 12:39:45.015587 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Openstack-System-Scope: None May 23 12:39:45.015587 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: User-Agent: python-urllib3/1.26.9 May 23 12:39:45.015587 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Auth-Token: gAAAAABii38ZU7Vwsw5AAU8G7deCk06Tjsg_k90-PVfeWrd3aNHg-oGVBFwUfnF7AZgHGAQrHmO4XQOE1Bz6uWE6i2CAUoXJsEuLNZGXvkqTPiv0H7N4ZSkFEsbSkgm2LM1J6iSbSGefN_01pdctKfH8BgGpUswrmPhK0nZLP7jsVPYKp_z7ea8 May 23 12:39:45.015587 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Id: None May 23 12:39:45.015587 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Name: None May 23 12:39:45.015587 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Identity-Status: Confirmed May 23 12:39:45.015587 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Is-Admin-Project: True May 23 12:39:45.015587 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Id: default May 23 12:39:45.015587 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Name: Default May 23 12:39:45.015587 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Id: da82f9c566664cb1a974cf0d1bf1b09d May 23 12:39:45.015587 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Name: tempest-AttachVolumeNegativeTest-2053273606 May 23 12:39:45.015587 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Role: member,reader May 23 12:39:45.015587 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Roles: member,reader May 23 12:39:45.016934 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da82f9c566664cb1a974cf0d1bf1b09d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da82f9c566664cb1a974cf0d1bf1b09d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da82f9c566664cb1a974cf0d1bf1b09d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da82f9c566664cb1a974cf0d1bf1b09d"}]}] May 23 12:39:45.016934 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant: tempest-AttachVolumeNegativeTest-2053273606 May 23 12:39:45.016934 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Id: da82f9c566664cb1a974cf0d1bf1b09d May 23 12:39:45.016934 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2053273606 May 23 12:39:45.016934 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User: tempest-AttachVolumeNegativeTest-2053273606-project May 23 12:39:45.016934 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Id: default May 23 12:39:45.016934 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Name: Default May 23 12:39:45.016934 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Id: ef222fe025534a9e942f8c5c4ed1e3e7 May 23 12:39:45.016934 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Name: tempest-AttachVolumeNegativeTest-2053273606-project May 23 12:39:45.016934 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: method: > May 23 12:39:45.016934 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: exception: Instance 203877da-d78e-44f0-bc6a-995008fef4f7 could not be found. May 23 12:39:45.016934 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: action_args: {'id': '203877da-d78e-44f0-bc6a-995008fef4f7'} May 23 12:39:45.017745 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:39:45.017745 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:39:45.017745 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:39:45.017745 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:39:45.017745 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:39:45.017745 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:39:45.017745 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:39:45.017745 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:39:45.017745 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:39:45.017745 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:39:45.017745 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 203877da-d78e-44f0-bc6a-995008fef4f7 could not be found. May 23 12:39:45.017745 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:45.017745 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:39:45.017745 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:45.017745 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:39:45.017745 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:39:45.017745 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:39:45.017745 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:39:45.017745 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:39:45.017745 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:39:45.018952 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:39:45.018952 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 12:39:45.018952 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 12:39:45.018952 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 12:39:45.018952 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 12:39:45.018952 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:39:45.018952 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:39:45.018952 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:39:45.018952 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:39:45.018952 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 203877da-d78e-44f0-bc6a-995008fef4f7 could not be found. May 23 12:39:45.018952 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:45.018952 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:39:45.018952 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:45.018952 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:39:45.018952 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:39:45.018952 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:39:45.018952 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:39:45.018952 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:39:45.018952 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 203877da-d78e-44f0-bc6a-995008fef4f7 could not be found. May 23 12:39:45.018952 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:45.021549 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-4bff701f-6038-4656-bf19-8a5eb0128bb5 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Returning 404 to user: Instance 203877da-d78e-44f0-bc6a-995008fef4f7 could not be found. {{(pid=124200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:39:45.022421 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-4bff701f-6038-4656-bf19-8a5eb0128bb5 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "DELETE /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7" status: 404 len: 111 microversion: 2.1 time: 0.039830 May 23 12:39:45.022981 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 387/768] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 12:39:44 2022] DELETE /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 12:39:45.031414 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-6c0ada3d-3a60-4eb6-aca4-ddb13e8699a6 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:45.032635 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-6c0ada3d-3a60-4eb6-aca4-ddb13e8699a6 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 203877da-d78e-44f0-bc6a-995008fef4f7] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:45.040625 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6c0ada3d-3a60-4eb6-aca4-ddb13e8699a6 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:45.041085 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6c0ada3d-3a60-4eb6-aca4-ddb13e8699a6 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:45.041886 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6c0ada3d-3a60-4eb6-aca4-ddb13e8699a6 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:45.042707 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-0d0b8752-1cf4-4d2e-9243-845343d2f221 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:45.043225 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6c0ada3d-3a60-4eb6-aca4-ddb13e8699a6 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:45.048695 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-0d0b8752-1cf4-4d2e-9243-845343d2f221 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:45.057465 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0d0b8752-1cf4-4d2e-9243-845343d2f221 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:45.058012 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0d0b8752-1cf4-4d2e-9243-845343d2f221 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:45.058927 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0d0b8752-1cf4-4d2e-9243-845343d2f221 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:45.059442 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0d0b8752-1cf4-4d2e-9243-845343d2f221 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:45.060528 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.wsgi [None req-6c0ada3d-3a60-4eb6-aca4-ddb13e8699a6 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] HTTP exception thrown: Instance 203877da-d78e-44f0-bc6a-995008fef4f7 could not be found. May 23 12:39:45.062197 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-6c0ada3d-3a60-4eb6-aca4-ddb13e8699a6 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Request method failure captured: May 23 12:39:45.062197 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: request: GET /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7 HTTP/1.1 May 23 12:39:45.062197 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept: application/json May 23 12:39:45.062197 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept-Encoding: identity May 23 12:39:45.062197 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Connection: close May 23 12:39:45.062197 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Length: 0 May 23 12:39:45.062197 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Type: application/json May 23 12:39:45.062197 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Host: 10.222.0.16 May 23 12:39:45.062197 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Openstack-System-Scope: None May 23 12:39:45.062197 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: User-Agent: python-urllib3/1.26.9 May 23 12:39:45.062197 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Auth-Token: gAAAAABii38ZU7Vwsw5AAU8G7deCk06Tjsg_k90-PVfeWrd3aNHg-oGVBFwUfnF7AZgHGAQrHmO4XQOE1Bz6uWE6i2CAUoXJsEuLNZGXvkqTPiv0H7N4ZSkFEsbSkgm2LM1J6iSbSGefN_01pdctKfH8BgGpUswrmPhK0nZLP7jsVPYKp_z7ea8 May 23 12:39:45.062197 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Id: None May 23 12:39:45.062197 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Name: None May 23 12:39:45.062197 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Identity-Status: Confirmed May 23 12:39:45.062197 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Is-Admin-Project: True May 23 12:39:45.062197 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Id: default May 23 12:39:45.062197 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Name: Default May 23 12:39:45.062197 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Id: da82f9c566664cb1a974cf0d1bf1b09d May 23 12:39:45.062197 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Name: tempest-AttachVolumeNegativeTest-2053273606 May 23 12:39:45.062197 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Role: member,reader May 23 12:39:45.062197 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Roles: member,reader May 23 12:39:45.063697 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da82f9c566664cb1a974cf0d1bf1b09d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da82f9c566664cb1a974cf0d1bf1b09d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da82f9c566664cb1a974cf0d1bf1b09d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da82f9c566664cb1a974cf0d1bf1b09d"}]}] May 23 12:39:45.063697 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant: tempest-AttachVolumeNegativeTest-2053273606 May 23 12:39:45.063697 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Id: da82f9c566664cb1a974cf0d1bf1b09d May 23 12:39:45.063697 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2053273606 May 23 12:39:45.063697 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User: tempest-AttachVolumeNegativeTest-2053273606-project May 23 12:39:45.063697 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Id: default May 23 12:39:45.063697 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Name: Default May 23 12:39:45.063697 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Id: ef222fe025534a9e942f8c5c4ed1e3e7 May 23 12:39:45.063697 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Name: tempest-AttachVolumeNegativeTest-2053273606-project May 23 12:39:45.063697 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: method: > May 23 12:39:45.063697 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: exception: Instance 203877da-d78e-44f0-bc6a-995008fef4f7 could not be found. May 23 12:39:45.063697 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: action_args: {'id': '203877da-d78e-44f0-bc6a-995008fef4f7'} May 23 12:39:45.068024 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:39:45.068024 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:39:45.068024 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:39:45.068024 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:39:45.068024 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:39:45.068024 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:39:45.068024 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:39:45.068024 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:39:45.068024 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:39:45.068024 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:39:45.068024 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 203877da-d78e-44f0-bc6a-995008fef4f7 could not be found. May 23 12:39:45.068024 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:39:45.068024 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:39:45.068024 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:39:45.068024 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:39:45.068024 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:39:45.068024 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:39:45.068024 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:39:45.068024 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:39:45.068024 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:39:45.069451 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:39:45.069451 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:39:45.069451 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:39:45.069451 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:39:45.069451 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:39:45.069451 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:39:45.069451 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:39:45.069451 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 203877da-d78e-44f0-bc6a-995008fef4f7 could not be found. May 23 12:39:45.069451 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:39:45.069451 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:39:45.069451 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:39:45.069451 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:39:45.069451 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:39:45.069451 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:39:45.069451 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:39:45.069451 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:39:45.069451 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 203877da-d78e-44f0-bc6a-995008fef4f7 could not be found. May 23 12:39:45.069451 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:39:45.070697 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-6c0ada3d-3a60-4eb6-aca4-ddb13e8699a6 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Returning 404 to user: Instance 203877da-d78e-44f0-bc6a-995008fef4f7 could not be found. {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:39:45.070697 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-6c0ada3d-3a60-4eb6-aca4-ddb13e8699a6 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7" status: 404 len: 111 microversion: 2.1 time: 0.036471 May 23 12:39:45.070697 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 382/769] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:45 2022] GET /compute/v2.1/servers/203877da-d78e-44f0-bc6a-995008fef4f7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:39:45.230450 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-0d0b8752-1cf4-4d2e-9243-845343d2f221 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:45.238787 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-0d0b8752-1cf4-4d2e-9243-845343d2f221 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:45.240758 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-0d0b8752-1cf4-4d2e-9243-845343d2f221 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:45.241913 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-0d0b8752-1cf4-4d2e-9243-845343d2f221 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.207446 May 23 12:39:45.242466 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 388/770] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:39:45 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:39:45.513975 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-83344b21-e564-4413-a066-3ea7e68843ce tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:45.514673 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-83344b21-e564-4413-a066-3ea7e68843ce tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:45.522233 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-83344b21-e564-4413-a066-3ea7e68843ce tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:45.522550 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-83344b21-e564-4413-a066-3ea7e68843ce tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:45.523320 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-83344b21-e564-4413-a066-3ea7e68843ce tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:45.523802 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-83344b21-e564-4413-a066-3ea7e68843ce tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:45.662766 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-83344b21-e564-4413-a066-3ea7e68843ce tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:45.670580 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-83344b21-e564-4413-a066-3ea7e68843ce tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1575 microversion: 2.1 time: 0.160661 May 23 12:39:45.671147 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 383/771] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:45 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:39:46.250508 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-21d85e64-c2c9-4747-9516-779312545513 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:46.251003 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-21d85e64-c2c9-4747-9516-779312545513 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: f2e15c2c-04cc-435b-a633-39c4ae1a5e24] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:46.258645 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-21d85e64-c2c9-4747-9516-779312545513 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:46.259332 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-21d85e64-c2c9-4747-9516-779312545513 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:46.260108 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-21d85e64-c2c9-4747-9516-779312545513 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:46.260568 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-21d85e64-c2c9-4747-9516-779312545513 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:46.261971 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-1ce8b92c-598e-4f83-bc04-0c01b216baf0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:46.262590 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-1ce8b92c-598e-4f83-bc04-0c01b216baf0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:46.268791 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1ce8b92c-598e-4f83-bc04-0c01b216baf0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:46.269316 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1ce8b92c-598e-4f83-bc04-0c01b216baf0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:46.270316 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1ce8b92c-598e-4f83-bc04-0c01b216baf0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:46.270943 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1ce8b92c-598e-4f83-bc04-0c01b216baf0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:46.274332 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.wsgi [None req-21d85e64-c2c9-4747-9516-779312545513 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] HTTP exception thrown: Instance f2e15c2c-04cc-435b-a633-39c4ae1a5e24 could not be found. May 23 12:39:46.275896 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-21d85e64-c2c9-4747-9516-779312545513 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Request method failure captured: May 23 12:39:46.275896 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: request: DELETE /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24 HTTP/1.1 May 23 12:39:46.275896 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept: application/json May 23 12:39:46.275896 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept-Encoding: identity May 23 12:39:46.275896 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Connection: close May 23 12:39:46.275896 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Length: 0 May 23 12:39:46.275896 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Type: application/json May 23 12:39:46.275896 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Host: 10.222.0.16 May 23 12:39:46.275896 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Openstack-System-Scope: None May 23 12:39:46.275896 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: User-Agent: python-urllib3/1.26.9 May 23 12:39:46.275896 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Auth-Token: gAAAAABii38ZU7Vwsw5AAU8G7deCk06Tjsg_k90-PVfeWrd3aNHg-oGVBFwUfnF7AZgHGAQrHmO4XQOE1Bz6uWE6i2CAUoXJsEuLNZGXvkqTPiv0H7N4ZSkFEsbSkgm2LM1J6iSbSGefN_01pdctKfH8BgGpUswrmPhK0nZLP7jsVPYKp_z7ea8 May 23 12:39:46.275896 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Id: None May 23 12:39:46.275896 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Name: None May 23 12:39:46.275896 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Identity-Status: Confirmed May 23 12:39:46.275896 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Is-Admin-Project: True May 23 12:39:46.275896 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Id: default May 23 12:39:46.275896 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Name: Default May 23 12:39:46.275896 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Id: da82f9c566664cb1a974cf0d1bf1b09d May 23 12:39:46.275896 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Name: tempest-AttachVolumeNegativeTest-2053273606 May 23 12:39:46.275896 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Role: member,reader May 23 12:39:46.275896 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Roles: member,reader May 23 12:39:46.277608 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da82f9c566664cb1a974cf0d1bf1b09d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da82f9c566664cb1a974cf0d1bf1b09d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da82f9c566664cb1a974cf0d1bf1b09d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da82f9c566664cb1a974cf0d1bf1b09d"}]}] May 23 12:39:46.277608 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant: tempest-AttachVolumeNegativeTest-2053273606 May 23 12:39:46.277608 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Id: da82f9c566664cb1a974cf0d1bf1b09d May 23 12:39:46.277608 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2053273606 May 23 12:39:46.277608 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User: tempest-AttachVolumeNegativeTest-2053273606-project May 23 12:39:46.277608 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Id: default May 23 12:39:46.277608 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Name: Default May 23 12:39:46.277608 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Id: ef222fe025534a9e942f8c5c4ed1e3e7 May 23 12:39:46.277608 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Name: tempest-AttachVolumeNegativeTest-2053273606-project May 23 12:39:46.277608 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: method: > May 23 12:39:46.277608 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: exception: Instance f2e15c2c-04cc-435b-a633-39c4ae1a5e24 could not be found. May 23 12:39:46.277608 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: action_args: {'id': 'f2e15c2c-04cc-435b-a633-39c4ae1a5e24'} May 23 12:39:46.278492 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:39:46.278492 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:39:46.278492 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:39:46.278492 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:39:46.278492 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:39:46.278492 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:39:46.278492 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:39:46.278492 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:39:46.278492 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:39:46.278492 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:39:46.278492 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2e15c2c-04cc-435b-a633-39c4ae1a5e24 could not be found. May 23 12:39:46.278492 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:46.278492 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:39:46.278492 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:46.278492 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:39:46.278492 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:39:46.278492 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:39:46.278492 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:39:46.278492 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:39:46.278492 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:39:46.280085 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:39:46.280085 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 12:39:46.280085 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 12:39:46.280085 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 12:39:46.280085 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 12:39:46.280085 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:39:46.280085 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:39:46.280085 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:39:46.280085 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:39:46.280085 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2e15c2c-04cc-435b-a633-39c4ae1a5e24 could not be found. May 23 12:39:46.280085 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:46.280085 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:39:46.280085 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:46.280085 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:39:46.280085 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:39:46.280085 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:39:46.280085 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:39:46.280085 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:39:46.280085 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2e15c2c-04cc-435b-a633-39c4ae1a5e24 could not be found. May 23 12:39:46.280085 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:46.282389 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-21d85e64-c2c9-4747-9516-779312545513 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Returning 404 to user: Instance f2e15c2c-04cc-435b-a633-39c4ae1a5e24 could not be found. {{(pid=124200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:39:46.282389 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-21d85e64-c2c9-4747-9516-779312545513 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24" status: 404 len: 111 microversion: 2.1 time: 0.030691 May 23 12:39:46.282389 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 389/772] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 12:39:46 2022] DELETE /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:39:46.286051 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-9d380a4c-3013-4ced-aa11-f73c6a63fbbf tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:46.286708 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-9d380a4c-3013-4ced-aa11-f73c6a63fbbf tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: f2e15c2c-04cc-435b-a633-39c4ae1a5e24] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:46.292597 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9d380a4c-3013-4ced-aa11-f73c6a63fbbf tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:46.293049 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9d380a4c-3013-4ced-aa11-f73c6a63fbbf tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:46.293816 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9d380a4c-3013-4ced-aa11-f73c6a63fbbf tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:46.294257 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9d380a4c-3013-4ced-aa11-f73c6a63fbbf tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:46.308156 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.wsgi [None req-9d380a4c-3013-4ced-aa11-f73c6a63fbbf tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] HTTP exception thrown: Instance f2e15c2c-04cc-435b-a633-39c4ae1a5e24 could not be found. May 23 12:39:46.309718 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-9d380a4c-3013-4ced-aa11-f73c6a63fbbf tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Request method failure captured: May 23 12:39:46.309718 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: request: GET /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24 HTTP/1.1 May 23 12:39:46.309718 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept: application/json May 23 12:39:46.309718 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept-Encoding: identity May 23 12:39:46.309718 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Connection: close May 23 12:39:46.309718 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Length: 0 May 23 12:39:46.309718 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Type: application/json May 23 12:39:46.309718 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Host: 10.222.0.16 May 23 12:39:46.309718 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Openstack-System-Scope: None May 23 12:39:46.309718 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: User-Agent: python-urllib3/1.26.9 May 23 12:39:46.309718 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Auth-Token: gAAAAABii38ZU7Vwsw5AAU8G7deCk06Tjsg_k90-PVfeWrd3aNHg-oGVBFwUfnF7AZgHGAQrHmO4XQOE1Bz6uWE6i2CAUoXJsEuLNZGXvkqTPiv0H7N4ZSkFEsbSkgm2LM1J6iSbSGefN_01pdctKfH8BgGpUswrmPhK0nZLP7jsVPYKp_z7ea8 May 23 12:39:46.309718 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Id: None May 23 12:39:46.309718 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Name: None May 23 12:39:46.309718 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Identity-Status: Confirmed May 23 12:39:46.309718 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Is-Admin-Project: True May 23 12:39:46.309718 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Id: default May 23 12:39:46.309718 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Name: Default May 23 12:39:46.309718 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Id: da82f9c566664cb1a974cf0d1bf1b09d May 23 12:39:46.309718 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Name: tempest-AttachVolumeNegativeTest-2053273606 May 23 12:39:46.309718 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Role: member,reader May 23 12:39:46.309718 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Roles: member,reader May 23 12:39:46.311327 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da82f9c566664cb1a974cf0d1bf1b09d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da82f9c566664cb1a974cf0d1bf1b09d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da82f9c566664cb1a974cf0d1bf1b09d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da82f9c566664cb1a974cf0d1bf1b09d"}]}] May 23 12:39:46.311327 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant: tempest-AttachVolumeNegativeTest-2053273606 May 23 12:39:46.311327 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Id: da82f9c566664cb1a974cf0d1bf1b09d May 23 12:39:46.311327 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2053273606 May 23 12:39:46.311327 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User: tempest-AttachVolumeNegativeTest-2053273606-project May 23 12:39:46.311327 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Id: default May 23 12:39:46.311327 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Name: Default May 23 12:39:46.311327 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Id: ef222fe025534a9e942f8c5c4ed1e3e7 May 23 12:39:46.311327 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Name: tempest-AttachVolumeNegativeTest-2053273606-project May 23 12:39:46.311327 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: method: > May 23 12:39:46.311327 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: exception: Instance f2e15c2c-04cc-435b-a633-39c4ae1a5e24 could not be found. May 23 12:39:46.311327 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: action_args: {'id': 'f2e15c2c-04cc-435b-a633-39c4ae1a5e24'} May 23 12:39:46.312291 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:39:46.312291 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:39:46.312291 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:39:46.312291 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:39:46.312291 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:39:46.312291 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:39:46.312291 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:39:46.312291 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:39:46.312291 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:39:46.312291 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:39:46.312291 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2e15c2c-04cc-435b-a633-39c4ae1a5e24 could not be found. May 23 12:39:46.312291 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:46.312291 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:39:46.312291 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:46.312291 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:39:46.312291 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:39:46.312291 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:39:46.312291 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:39:46.312291 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:39:46.312291 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:39:46.313780 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:39:46.313780 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:39:46.313780 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:39:46.313780 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:39:46.313780 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:39:46.313780 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:39:46.313780 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:39:46.313780 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2e15c2c-04cc-435b-a633-39c4ae1a5e24 could not be found. May 23 12:39:46.313780 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:46.313780 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:39:46.313780 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:46.313780 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:39:46.313780 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:39:46.313780 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:39:46.313780 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:39:46.313780 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:39:46.313780 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2e15c2c-04cc-435b-a633-39c4ae1a5e24 could not be found. May 23 12:39:46.313780 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:46.315497 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-9d380a4c-3013-4ced-aa11-f73c6a63fbbf tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Returning 404 to user: Instance f2e15c2c-04cc-435b-a633-39c4ae1a5e24 could not be found. {{(pid=124200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:39:46.315497 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-9d380a4c-3013-4ced-aa11-f73c6a63fbbf tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24" status: 404 len: 111 microversion: 2.1 time: 0.029264 May 23 12:39:46.315497 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 390/773] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:46 2022] GET /compute/v2.1/servers/f2e15c2c-04cc-435b-a633-39c4ae1a5e24 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 12:39:46.319297 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-84a8b24e-7c59-4aff-a2e5-0db7c77216a1 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:46.319791 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-84a8b24e-7c59-4aff-a2e5-0db7c77216a1 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: a624bb16-d6b7-491a-9724-9a51af12140d] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:46.326118 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-84a8b24e-7c59-4aff-a2e5-0db7c77216a1 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:46.326573 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-84a8b24e-7c59-4aff-a2e5-0db7c77216a1 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:46.327340 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-84a8b24e-7c59-4aff-a2e5-0db7c77216a1 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:46.327780 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-84a8b24e-7c59-4aff-a2e5-0db7c77216a1 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:46.342065 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.wsgi [None req-84a8b24e-7c59-4aff-a2e5-0db7c77216a1 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] HTTP exception thrown: Instance a624bb16-d6b7-491a-9724-9a51af12140d could not be found. May 23 12:39:46.343627 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-84a8b24e-7c59-4aff-a2e5-0db7c77216a1 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Request method failure captured: May 23 12:39:46.343627 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: request: DELETE /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d HTTP/1.1 May 23 12:39:46.343627 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept: application/json May 23 12:39:46.343627 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept-Encoding: identity May 23 12:39:46.343627 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Connection: close May 23 12:39:46.343627 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Length: 0 May 23 12:39:46.343627 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Type: application/json May 23 12:39:46.343627 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Host: 10.222.0.16 May 23 12:39:46.343627 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Openstack-System-Scope: None May 23 12:39:46.343627 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: User-Agent: python-urllib3/1.26.9 May 23 12:39:46.343627 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Auth-Token: gAAAAABii38ZU7Vwsw5AAU8G7deCk06Tjsg_k90-PVfeWrd3aNHg-oGVBFwUfnF7AZgHGAQrHmO4XQOE1Bz6uWE6i2CAUoXJsEuLNZGXvkqTPiv0H7N4ZSkFEsbSkgm2LM1J6iSbSGefN_01pdctKfH8BgGpUswrmPhK0nZLP7jsVPYKp_z7ea8 May 23 12:39:46.343627 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Id: None May 23 12:39:46.343627 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Name: None May 23 12:39:46.343627 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Identity-Status: Confirmed May 23 12:39:46.343627 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Is-Admin-Project: True May 23 12:39:46.343627 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Id: default May 23 12:39:46.343627 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Name: Default May 23 12:39:46.343627 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Id: da82f9c566664cb1a974cf0d1bf1b09d May 23 12:39:46.343627 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Name: tempest-AttachVolumeNegativeTest-2053273606 May 23 12:39:46.343627 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Role: member,reader May 23 12:39:46.343627 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Roles: member,reader May 23 12:39:46.345286 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da82f9c566664cb1a974cf0d1bf1b09d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da82f9c566664cb1a974cf0d1bf1b09d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da82f9c566664cb1a974cf0d1bf1b09d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da82f9c566664cb1a974cf0d1bf1b09d"}]}] May 23 12:39:46.345286 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant: tempest-AttachVolumeNegativeTest-2053273606 May 23 12:39:46.345286 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Id: da82f9c566664cb1a974cf0d1bf1b09d May 23 12:39:46.345286 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2053273606 May 23 12:39:46.345286 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User: tempest-AttachVolumeNegativeTest-2053273606-project May 23 12:39:46.345286 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Id: default May 23 12:39:46.345286 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Name: Default May 23 12:39:46.345286 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Id: ef222fe025534a9e942f8c5c4ed1e3e7 May 23 12:39:46.345286 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Name: tempest-AttachVolumeNegativeTest-2053273606-project May 23 12:39:46.345286 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: method: > May 23 12:39:46.345286 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: exception: Instance a624bb16-d6b7-491a-9724-9a51af12140d could not be found. May 23 12:39:46.345286 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: action_args: {'id': 'a624bb16-d6b7-491a-9724-9a51af12140d'} May 23 12:39:46.346077 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:39:46.346077 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:39:46.346077 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:39:46.346077 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:39:46.346077 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:39:46.346077 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:39:46.346077 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:39:46.346077 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:39:46.346077 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:39:46.346077 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:39:46.346077 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a624bb16-d6b7-491a-9724-9a51af12140d could not be found. May 23 12:39:46.346077 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:46.346077 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:39:46.346077 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:46.346077 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:39:46.346077 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:39:46.346077 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:39:46.346077 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:39:46.346077 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:39:46.346077 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:39:46.347500 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:39:46.347500 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 12:39:46.347500 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 12:39:46.347500 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 12:39:46.347500 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 12:39:46.347500 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:39:46.347500 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:39:46.347500 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:39:46.347500 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:39:46.347500 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a624bb16-d6b7-491a-9724-9a51af12140d could not be found. May 23 12:39:46.347500 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:46.347500 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:39:46.347500 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:46.347500 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:39:46.347500 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:39:46.347500 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:39:46.347500 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:39:46.347500 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:39:46.347500 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a624bb16-d6b7-491a-9724-9a51af12140d could not be found. May 23 12:39:46.347500 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:46.349878 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-84a8b24e-7c59-4aff-a2e5-0db7c77216a1 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Returning 404 to user: Instance a624bb16-d6b7-491a-9724-9a51af12140d could not be found. {{(pid=124200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:39:46.349878 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-84a8b24e-7c59-4aff-a2e5-0db7c77216a1 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d" status: 404 len: 111 microversion: 2.1 time: 0.029517 May 23 12:39:46.349878 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 391/774] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 12:39:46 2022] DELETE /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 12:39:46.353732 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-17af0d20-88de-47c4-affb-b3abe370b9a8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:46.354344 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-17af0d20-88de-47c4-affb-b3abe370b9a8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: a624bb16-d6b7-491a-9724-9a51af12140d] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:46.361063 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-17af0d20-88de-47c4-affb-b3abe370b9a8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:46.361652 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-17af0d20-88de-47c4-affb-b3abe370b9a8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:46.362505 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-17af0d20-88de-47c4-affb-b3abe370b9a8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:46.363012 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-17af0d20-88de-47c4-affb-b3abe370b9a8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:46.378288 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.wsgi [None req-17af0d20-88de-47c4-affb-b3abe370b9a8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] HTTP exception thrown: Instance a624bb16-d6b7-491a-9724-9a51af12140d could not be found. May 23 12:39:46.380134 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-17af0d20-88de-47c4-affb-b3abe370b9a8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Request method failure captured: May 23 12:39:46.380134 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: request: GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d HTTP/1.1 May 23 12:39:46.380134 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept: application/json May 23 12:39:46.380134 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept-Encoding: identity May 23 12:39:46.380134 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Connection: close May 23 12:39:46.380134 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Length: 0 May 23 12:39:46.380134 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Type: application/json May 23 12:39:46.380134 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Host: 10.222.0.16 May 23 12:39:46.380134 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Openstack-System-Scope: None May 23 12:39:46.380134 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: User-Agent: python-urllib3/1.26.9 May 23 12:39:46.380134 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Auth-Token: gAAAAABii38ZU7Vwsw5AAU8G7deCk06Tjsg_k90-PVfeWrd3aNHg-oGVBFwUfnF7AZgHGAQrHmO4XQOE1Bz6uWE6i2CAUoXJsEuLNZGXvkqTPiv0H7N4ZSkFEsbSkgm2LM1J6iSbSGefN_01pdctKfH8BgGpUswrmPhK0nZLP7jsVPYKp_z7ea8 May 23 12:39:46.380134 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Id: None May 23 12:39:46.380134 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Name: None May 23 12:39:46.380134 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Identity-Status: Confirmed May 23 12:39:46.380134 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Is-Admin-Project: True May 23 12:39:46.380134 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Id: default May 23 12:39:46.380134 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Name: Default May 23 12:39:46.380134 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Id: da82f9c566664cb1a974cf0d1bf1b09d May 23 12:39:46.380134 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Name: tempest-AttachVolumeNegativeTest-2053273606 May 23 12:39:46.380134 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Role: member,reader May 23 12:39:46.380134 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Roles: member,reader May 23 12:39:46.381780 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da82f9c566664cb1a974cf0d1bf1b09d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da82f9c566664cb1a974cf0d1bf1b09d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da82f9c566664cb1a974cf0d1bf1b09d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da82f9c566664cb1a974cf0d1bf1b09d"}]}] May 23 12:39:46.381780 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant: tempest-AttachVolumeNegativeTest-2053273606 May 23 12:39:46.381780 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Id: da82f9c566664cb1a974cf0d1bf1b09d May 23 12:39:46.381780 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2053273606 May 23 12:39:46.381780 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User: tempest-AttachVolumeNegativeTest-2053273606-project May 23 12:39:46.381780 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Id: default May 23 12:39:46.381780 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Name: Default May 23 12:39:46.381780 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Id: ef222fe025534a9e942f8c5c4ed1e3e7 May 23 12:39:46.381780 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Name: tempest-AttachVolumeNegativeTest-2053273606-project May 23 12:39:46.381780 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: method: > May 23 12:39:46.381780 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: exception: Instance a624bb16-d6b7-491a-9724-9a51af12140d could not be found. May 23 12:39:46.381780 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: action_args: {'id': 'a624bb16-d6b7-491a-9724-9a51af12140d'} May 23 12:39:46.382685 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:39:46.382685 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:39:46.382685 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:39:46.382685 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:39:46.382685 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:39:46.382685 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:39:46.382685 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:39:46.382685 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:39:46.382685 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:39:46.382685 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:39:46.382685 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a624bb16-d6b7-491a-9724-9a51af12140d could not be found. May 23 12:39:46.382685 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:46.382685 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:39:46.382685 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:46.382685 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:39:46.382685 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:39:46.382685 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:39:46.382685 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:39:46.382685 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:39:46.382685 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:39:46.385600 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:39:46.385600 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:39:46.385600 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:39:46.385600 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:39:46.385600 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:39:46.385600 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:39:46.385600 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:39:46.385600 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a624bb16-d6b7-491a-9724-9a51af12140d could not be found. May 23 12:39:46.385600 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:46.385600 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:39:46.385600 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:46.385600 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:39:46.385600 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:39:46.385600 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:39:46.385600 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:39:46.385600 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:39:46.385600 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a624bb16-d6b7-491a-9724-9a51af12140d could not be found. May 23 12:39:46.385600 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:46.387819 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-17af0d20-88de-47c4-affb-b3abe370b9a8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Returning 404 to user: Instance a624bb16-d6b7-491a-9724-9a51af12140d could not be found. {{(pid=124200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:39:46.387819 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-17af0d20-88de-47c4-affb-b3abe370b9a8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d" status: 404 len: 111 microversion: 2.1 time: 0.032815 May 23 12:39:46.387819 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 392/775] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:46 2022] GET /compute/v2.1/servers/a624bb16-d6b7-491a-9724-9a51af12140d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:39:46.424678 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1ce8b92c-598e-4f83-bc04-0c01b216baf0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:46.440326 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1ce8b92c-598e-4f83-bc04-0c01b216baf0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:46.442425 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1ce8b92c-598e-4f83-bc04-0c01b216baf0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:46.443828 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-1ce8b92c-598e-4f83-bc04-0c01b216baf0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.187061 May 23 12:39:46.445024 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 384/776] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:39:46 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:39:46.534068 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-107501da-5e10-4840-9415-45ceea62f6bb req-ee0db74d-e710-4e3a-b58e-5f5e797f0d74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1acfc6ec-6e8f-4969-99e8-0de456fcb7ed", "name": "network-vif-plugged", "status": "completed", "tag": "6629f354-c1e7-44f4-90fa-1e340bce002d"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:39:46.542735 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-107501da-5e10-4840-9415-45ceea62f6bb req-ee0db74d-e710-4e3a-b58e-5f5e797f0d74 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:46.543122 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-107501da-5e10-4840-9415-45ceea62f6bb req-ee0db74d-e710-4e3a-b58e-5f5e797f0d74 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:46.555621 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-107501da-5e10-4840-9415-45ceea62f6bb req-ee0db74d-e710-4e3a-b58e-5f5e797f0d74 service nova] Creating event network-vif-plugged:6629f354-c1e7-44f4-90fa-1e340bce002d for instance 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed on hv-cinder-83699 May 23 12:39:46.560538 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-107501da-5e10-4840-9415-45ceea62f6bb req-ee0db74d-e710-4e3a-b58e-5f5e797f0d74 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030170 May 23 12:39:46.561137 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 393/777] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:39:46.689567 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-5e50d5cd-2322-4c99-8d9e-e60aa890185d tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:46.690503 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-5e50d5cd-2322-4c99-8d9e-e60aa890185d tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:46.697289 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5e50d5cd-2322-4c99-8d9e-e60aa890185d tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:46.698075 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5e50d5cd-2322-4c99-8d9e-e60aa890185d tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:46.699026 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5e50d5cd-2322-4c99-8d9e-e60aa890185d tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:46.699691 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5e50d5cd-2322-4c99-8d9e-e60aa890185d tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:46.853182 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-145a7475-2d98-44ab-bcf3-b0ddf7ef628a tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:46.853922 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-145a7475-2d98-44ab-bcf3-b0ddf7ef628a tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 9a267457-7f06-4312-87ce-2c47cdb2924d] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:46.860332 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-145a7475-2d98-44ab-bcf3-b0ddf7ef628a tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:46.860859 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-145a7475-2d98-44ab-bcf3-b0ddf7ef628a tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:46.861641 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-145a7475-2d98-44ab-bcf3-b0ddf7ef628a tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:46.862081 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-145a7475-2d98-44ab-bcf3-b0ddf7ef628a tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:46.877385 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.wsgi [None req-145a7475-2d98-44ab-bcf3-b0ddf7ef628a tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] HTTP exception thrown: Instance 9a267457-7f06-4312-87ce-2c47cdb2924d could not be found. May 23 12:39:46.879164 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-145a7475-2d98-44ab-bcf3-b0ddf7ef628a tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Request method failure captured: May 23 12:39:46.879164 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: request: DELETE /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d HTTP/1.1 May 23 12:39:46.879164 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept: application/json May 23 12:39:46.879164 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept-Encoding: identity May 23 12:39:46.879164 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Connection: close May 23 12:39:46.879164 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Length: 0 May 23 12:39:46.879164 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Type: application/json May 23 12:39:46.879164 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Host: 10.222.0.16 May 23 12:39:46.879164 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Openstack-System-Scope: None May 23 12:39:46.879164 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: User-Agent: python-urllib3/1.26.9 May 23 12:39:46.879164 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Auth-Token: gAAAAABii38aXdKGMOEVZ2spEcutkaQ86Yc_NLCUbMHOXXQH8Bm8w2vzfmASCK0LDJk-Hh7hHX90aFsUsBLdB-dTHGD9i7_ibWA6MXmnHMUtHbJnyrAFrC09GqDvy-mdyJpa7IcS6ayZUQlOhJ_hIkrPICcxCi1iE5fq6VI-EmRi6tTe7pQxsRo May 23 12:39:46.879164 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Id: None May 23 12:39:46.879164 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Name: None May 23 12:39:46.879164 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Identity-Status: Confirmed May 23 12:39:46.879164 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Is-Admin-Project: True May 23 12:39:46.879164 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Id: default May 23 12:39:46.879164 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Name: Default May 23 12:39:46.879164 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Id: 736376830ed340b2aa62c455c134c4e2 May 23 12:39:46.879164 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Name: tempest-AttachVolumeTestJSON-2113320926 May 23 12:39:46.879164 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Role: member,reader May 23 12:39:46.879164 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Roles: member,reader May 23 12:39:46.880896 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/736376830ed340b2aa62c455c134c4e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/736376830ed340b2aa62c455c134c4e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_736376830ed340b2aa62c455c134c4e2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/736376830ed340b2aa62c455c134c4e2"}]}] May 23 12:39:46.880896 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant: tempest-AttachVolumeTestJSON-2113320926 May 23 12:39:46.880896 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Id: 736376830ed340b2aa62c455c134c4e2 May 23 12:39:46.880896 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2113320926 May 23 12:39:46.880896 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User: tempest-AttachVolumeTestJSON-2113320926-project May 23 12:39:46.880896 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Id: default May 23 12:39:46.880896 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Name: Default May 23 12:39:46.880896 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Id: 771d3e22beff44f7bbc3103fd75a35b4 May 23 12:39:46.880896 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Name: tempest-AttachVolumeTestJSON-2113320926-project May 23 12:39:46.880896 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: method: > May 23 12:39:46.880896 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: exception: Instance 9a267457-7f06-4312-87ce-2c47cdb2924d could not be found. May 23 12:39:46.880896 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: action_args: {'id': '9a267457-7f06-4312-87ce-2c47cdb2924d'} May 23 12:39:46.881770 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:39:46.881770 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:39:46.881770 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:39:46.881770 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:39:46.881770 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:39:46.881770 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:39:46.881770 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:39:46.881770 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:39:46.881770 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:39:46.881770 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:39:46.881770 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a267457-7f06-4312-87ce-2c47cdb2924d could not be found. May 23 12:39:46.881770 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:46.881770 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:39:46.881770 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:46.881770 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:39:46.881770 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:39:46.881770 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:39:46.881770 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:39:46.881770 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:39:46.881770 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:39:46.883059 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:39:46.883059 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 12:39:46.883059 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 12:39:46.883059 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 12:39:46.883059 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 12:39:46.883059 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:39:46.883059 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:39:46.883059 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:39:46.883059 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:39:46.883059 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a267457-7f06-4312-87ce-2c47cdb2924d could not be found. May 23 12:39:46.883059 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:46.883059 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:39:46.883059 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:46.883059 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:39:46.883059 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:39:46.883059 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:39:46.883059 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:39:46.883059 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:39:46.883059 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a267457-7f06-4312-87ce-2c47cdb2924d could not be found. May 23 12:39:46.883059 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:46.884326 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-145a7475-2d98-44ab-bcf3-b0ddf7ef628a tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Returning 404 to user: Instance 9a267457-7f06-4312-87ce-2c47cdb2924d could not be found. {{(pid=124200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:39:46.884326 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-145a7475-2d98-44ab-bcf3-b0ddf7ef628a tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d" status: 404 len: 111 microversion: 2.1 time: 0.032843 May 23 12:39:46.884326 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 394/778] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 12:39:46 2022] DELETE /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 12:39:46.889571 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-7adfb5b5-b1cb-48ec-b768-98b61c7b6fa0 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:46.890291 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-7adfb5b5-b1cb-48ec-b768-98b61c7b6fa0 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 9a267457-7f06-4312-87ce-2c47cdb2924d] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:46.898733 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7adfb5b5-b1cb-48ec-b768-98b61c7b6fa0 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:46.899189 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7adfb5b5-b1cb-48ec-b768-98b61c7b6fa0 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:46.899974 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7adfb5b5-b1cb-48ec-b768-98b61c7b6fa0 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:46.900443 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7adfb5b5-b1cb-48ec-b768-98b61c7b6fa0 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:46.907628 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-5e50d5cd-2322-4c99-8d9e-e60aa890185d tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:46.915963 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.wsgi [None req-7adfb5b5-b1cb-48ec-b768-98b61c7b6fa0 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] HTTP exception thrown: Instance 9a267457-7f06-4312-87ce-2c47cdb2924d could not be found. May 23 12:39:46.916407 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-5e50d5cd-2322-4c99-8d9e-e60aa890185d tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1575 microversion: 2.1 time: 0.230824 May 23 12:39:46.916974 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 385/779] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:46 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1575 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:39:46.917546 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-7adfb5b5-b1cb-48ec-b768-98b61c7b6fa0 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Request method failure captured: May 23 12:39:46.917546 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: request: GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d HTTP/1.1 May 23 12:39:46.917546 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept: application/json May 23 12:39:46.917546 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept-Encoding: identity May 23 12:39:46.917546 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Connection: close May 23 12:39:46.917546 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Length: 0 May 23 12:39:46.917546 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Type: application/json May 23 12:39:46.917546 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Host: 10.222.0.16 May 23 12:39:46.917546 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Openstack-System-Scope: None May 23 12:39:46.917546 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: User-Agent: python-urllib3/1.26.9 May 23 12:39:46.917546 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Auth-Token: gAAAAABii38aXdKGMOEVZ2spEcutkaQ86Yc_NLCUbMHOXXQH8Bm8w2vzfmASCK0LDJk-Hh7hHX90aFsUsBLdB-dTHGD9i7_ibWA6MXmnHMUtHbJnyrAFrC09GqDvy-mdyJpa7IcS6ayZUQlOhJ_hIkrPICcxCi1iE5fq6VI-EmRi6tTe7pQxsRo May 23 12:39:46.917546 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Id: None May 23 12:39:46.917546 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Name: None May 23 12:39:46.917546 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Identity-Status: Confirmed May 23 12:39:46.917546 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Is-Admin-Project: True May 23 12:39:46.917546 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Id: default May 23 12:39:46.917546 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Name: Default May 23 12:39:46.917546 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Id: 736376830ed340b2aa62c455c134c4e2 May 23 12:39:46.917546 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Name: tempest-AttachVolumeTestJSON-2113320926 May 23 12:39:46.917546 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Role: member,reader May 23 12:39:46.917546 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Roles: member,reader May 23 12:39:46.919055 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/736376830ed340b2aa62c455c134c4e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/736376830ed340b2aa62c455c134c4e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_736376830ed340b2aa62c455c134c4e2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/736376830ed340b2aa62c455c134c4e2"}]}] May 23 12:39:46.919055 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant: tempest-AttachVolumeTestJSON-2113320926 May 23 12:39:46.919055 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Id: 736376830ed340b2aa62c455c134c4e2 May 23 12:39:46.919055 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2113320926 May 23 12:39:46.919055 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User: tempest-AttachVolumeTestJSON-2113320926-project May 23 12:39:46.919055 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Id: default May 23 12:39:46.919055 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Name: Default May 23 12:39:46.919055 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Id: 771d3e22beff44f7bbc3103fd75a35b4 May 23 12:39:46.919055 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Name: tempest-AttachVolumeTestJSON-2113320926-project May 23 12:39:46.919055 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: method: > May 23 12:39:46.919055 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: exception: Instance 9a267457-7f06-4312-87ce-2c47cdb2924d could not be found. May 23 12:39:46.919055 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: action_args: {'id': '9a267457-7f06-4312-87ce-2c47cdb2924d'} May 23 12:39:46.919863 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:39:46.919863 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:39:46.919863 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:39:46.919863 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:39:46.919863 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:39:46.919863 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:39:46.919863 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:39:46.919863 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:39:46.919863 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:39:46.919863 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:39:46.919863 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a267457-7f06-4312-87ce-2c47cdb2924d could not be found. May 23 12:39:46.919863 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:46.919863 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:39:46.919863 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:46.919863 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:39:46.919863 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:39:46.919863 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:39:46.919863 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:39:46.919863 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:39:46.919863 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:39:46.921304 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:39:46.921304 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:39:46.921304 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:39:46.921304 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:39:46.921304 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:39:46.921304 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:39:46.921304 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:39:46.921304 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a267457-7f06-4312-87ce-2c47cdb2924d could not be found. May 23 12:39:46.921304 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:46.921304 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:39:46.921304 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:46.921304 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:39:46.921304 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:39:46.921304 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:39:46.921304 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:39:46.921304 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:39:46.921304 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a267457-7f06-4312-87ce-2c47cdb2924d could not be found. May 23 12:39:46.921304 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:46.922572 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-7adfb5b5-b1cb-48ec-b768-98b61c7b6fa0 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Returning 404 to user: Instance 9a267457-7f06-4312-87ce-2c47cdb2924d could not be found. {{(pid=124200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:39:46.922572 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-7adfb5b5-b1cb-48ec-b768-98b61c7b6fa0 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d" status: 404 len: 111 microversion: 2.1 time: 0.033213 May 23 12:39:46.922572 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 395/780] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:46 2022] GET /compute/v2.1/servers/9a267457-7f06-4312-87ce-2c47cdb2924d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:39:47.463253 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-156aebdd-f6b0-44ac-ab79-aebd49414b89 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:47.463933 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-156aebdd-f6b0-44ac-ab79-aebd49414b89 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:47.473929 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-156aebdd-f6b0-44ac-ab79-aebd49414b89 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:47.474385 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-156aebdd-f6b0-44ac-ab79-aebd49414b89 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:47.475170 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-156aebdd-f6b0-44ac-ab79-aebd49414b89 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:47.475614 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-156aebdd-f6b0-44ac-ab79-aebd49414b89 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:47.546329 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-755a92fe-2769-467b-b4a4-7aa0a49200f8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:47.546897 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-755a92fe-2769-467b-b4a4-7aa0a49200f8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:47.554153 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-755a92fe-2769-467b-b4a4-7aa0a49200f8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:47.554684 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-755a92fe-2769-467b-b4a4-7aa0a49200f8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:47.555532 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-755a92fe-2769-467b-b4a4-7aa0a49200f8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:47.556193 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-755a92fe-2769-467b-b4a4-7aa0a49200f8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:47.570932 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.wsgi [None req-755a92fe-2769-467b-b4a4-7aa0a49200f8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] HTTP exception thrown: Instance 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 could not be found. May 23 12:39:47.572526 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-755a92fe-2769-467b-b4a4-7aa0a49200f8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Request method failure captured: May 23 12:39:47.572526 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: request: DELETE /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 HTTP/1.1 May 23 12:39:47.572526 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept: application/json May 23 12:39:47.572526 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept-Encoding: identity May 23 12:39:47.572526 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Connection: close May 23 12:39:47.572526 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Length: 0 May 23 12:39:47.572526 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Type: application/json May 23 12:39:47.572526 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Host: 10.222.0.16 May 23 12:39:47.572526 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Openstack-System-Scope: None May 23 12:39:47.572526 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: User-Agent: python-urllib3/1.26.9 May 23 12:39:47.572526 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Auth-Token: gAAAAABii38ZU7Vwsw5AAU8G7deCk06Tjsg_k90-PVfeWrd3aNHg-oGVBFwUfnF7AZgHGAQrHmO4XQOE1Bz6uWE6i2CAUoXJsEuLNZGXvkqTPiv0H7N4ZSkFEsbSkgm2LM1J6iSbSGefN_01pdctKfH8BgGpUswrmPhK0nZLP7jsVPYKp_z7ea8 May 23 12:39:47.572526 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Id: None May 23 12:39:47.572526 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Name: None May 23 12:39:47.572526 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Identity-Status: Confirmed May 23 12:39:47.572526 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Is-Admin-Project: True May 23 12:39:47.572526 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Id: default May 23 12:39:47.572526 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Name: Default May 23 12:39:47.572526 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Id: da82f9c566664cb1a974cf0d1bf1b09d May 23 12:39:47.572526 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Name: tempest-AttachVolumeNegativeTest-2053273606 May 23 12:39:47.572526 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Role: member,reader May 23 12:39:47.572526 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Roles: member,reader May 23 12:39:47.574136 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da82f9c566664cb1a974cf0d1bf1b09d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da82f9c566664cb1a974cf0d1bf1b09d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da82f9c566664cb1a974cf0d1bf1b09d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da82f9c566664cb1a974cf0d1bf1b09d"}]}] May 23 12:39:47.574136 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant: tempest-AttachVolumeNegativeTest-2053273606 May 23 12:39:47.574136 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Id: da82f9c566664cb1a974cf0d1bf1b09d May 23 12:39:47.574136 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2053273606 May 23 12:39:47.574136 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User: tempest-AttachVolumeNegativeTest-2053273606-project May 23 12:39:47.574136 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Id: default May 23 12:39:47.574136 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Name: Default May 23 12:39:47.574136 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Id: ef222fe025534a9e942f8c5c4ed1e3e7 May 23 12:39:47.574136 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Name: tempest-AttachVolumeNegativeTest-2053273606-project May 23 12:39:47.574136 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: method: > May 23 12:39:47.574136 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: exception: Instance 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 could not be found. May 23 12:39:47.574136 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: action_args: {'id': '9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5'} May 23 12:39:47.574960 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:39:47.574960 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:39:47.574960 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:39:47.574960 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:39:47.574960 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:39:47.574960 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:39:47.574960 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:39:47.574960 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:39:47.574960 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:39:47.574960 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:39:47.574960 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 could not be found. May 23 12:39:47.574960 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:47.574960 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:39:47.574960 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:47.574960 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:39:47.574960 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:39:47.574960 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:39:47.574960 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:39:47.574960 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:39:47.574960 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:39:47.576442 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:39:47.576442 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 12:39:47.576442 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 12:39:47.576442 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 12:39:47.576442 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 12:39:47.576442 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:39:47.576442 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:39:47.576442 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:39:47.576442 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:39:47.576442 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 could not be found. May 23 12:39:47.576442 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:47.576442 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:39:47.576442 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:47.576442 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:39:47.576442 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:39:47.576442 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:39:47.576442 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:39:47.576442 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:39:47.576442 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 could not be found. May 23 12:39:47.576442 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:47.577774 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-755a92fe-2769-467b-b4a4-7aa0a49200f8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Returning 404 to user: Instance 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 could not be found. {{(pid=124200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:39:47.577774 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-755a92fe-2769-467b-b4a4-7aa0a49200f8 tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5" status: 404 len: 111 microversion: 2.1 time: 0.031896 May 23 12:39:47.577774 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 396/781] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 12:39:47 2022] DELETE /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:39:47.582486 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-44d9ca53-ed3b-4731-b06d-04c46609007f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:47.583091 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-44d9ca53-ed3b-4731-b06d-04c46609007f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] [instance: 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:47.589571 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-44d9ca53-ed3b-4731-b06d-04c46609007f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:47.590026 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-44d9ca53-ed3b-4731-b06d-04c46609007f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:47.590813 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-44d9ca53-ed3b-4731-b06d-04c46609007f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:47.591258 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-44d9ca53-ed3b-4731-b06d-04c46609007f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:47.604985 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.wsgi [None req-44d9ca53-ed3b-4731-b06d-04c46609007f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] HTTP exception thrown: Instance 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 could not be found. May 23 12:39:47.606558 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-44d9ca53-ed3b-4731-b06d-04c46609007f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Request method failure captured: May 23 12:39:47.606558 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: request: GET /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 HTTP/1.1 May 23 12:39:47.606558 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept: application/json May 23 12:39:47.606558 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept-Encoding: identity May 23 12:39:47.606558 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Connection: close May 23 12:39:47.606558 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Length: 0 May 23 12:39:47.606558 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Type: application/json May 23 12:39:47.606558 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Host: 10.222.0.16 May 23 12:39:47.606558 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Openstack-System-Scope: None May 23 12:39:47.606558 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: User-Agent: python-urllib3/1.26.9 May 23 12:39:47.606558 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Auth-Token: gAAAAABii38ZU7Vwsw5AAU8G7deCk06Tjsg_k90-PVfeWrd3aNHg-oGVBFwUfnF7AZgHGAQrHmO4XQOE1Bz6uWE6i2CAUoXJsEuLNZGXvkqTPiv0H7N4ZSkFEsbSkgm2LM1J6iSbSGefN_01pdctKfH8BgGpUswrmPhK0nZLP7jsVPYKp_z7ea8 May 23 12:39:47.606558 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Id: None May 23 12:39:47.606558 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Name: None May 23 12:39:47.606558 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Identity-Status: Confirmed May 23 12:39:47.606558 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Is-Admin-Project: True May 23 12:39:47.606558 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Id: default May 23 12:39:47.606558 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Name: Default May 23 12:39:47.606558 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Id: da82f9c566664cb1a974cf0d1bf1b09d May 23 12:39:47.606558 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Name: tempest-AttachVolumeNegativeTest-2053273606 May 23 12:39:47.606558 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Role: member,reader May 23 12:39:47.606558 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Roles: member,reader May 23 12:39:47.608567 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da82f9c566664cb1a974cf0d1bf1b09d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da82f9c566664cb1a974cf0d1bf1b09d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da82f9c566664cb1a974cf0d1bf1b09d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da82f9c566664cb1a974cf0d1bf1b09d"}]}] May 23 12:39:47.608567 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant: tempest-AttachVolumeNegativeTest-2053273606 May 23 12:39:47.608567 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Id: da82f9c566664cb1a974cf0d1bf1b09d May 23 12:39:47.608567 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2053273606 May 23 12:39:47.608567 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User: tempest-AttachVolumeNegativeTest-2053273606-project May 23 12:39:47.608567 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Id: default May 23 12:39:47.608567 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Name: Default May 23 12:39:47.608567 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Id: ef222fe025534a9e942f8c5c4ed1e3e7 May 23 12:39:47.608567 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Name: tempest-AttachVolumeNegativeTest-2053273606-project May 23 12:39:47.608567 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: method: > May 23 12:39:47.608567 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: exception: Instance 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 could not be found. May 23 12:39:47.608567 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: action_args: {'id': '9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5'} May 23 12:39:47.609505 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:39:47.609505 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:39:47.609505 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:39:47.609505 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:39:47.609505 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:39:47.609505 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:39:47.609505 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:39:47.609505 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:39:47.609505 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:39:47.609505 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:39:47.609505 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 could not be found. May 23 12:39:47.609505 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:47.609505 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:39:47.609505 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:47.609505 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:39:47.609505 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:39:47.609505 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:39:47.609505 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:39:47.609505 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:39:47.609505 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:39:47.610678 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:39:47.610678 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:39:47.610678 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:39:47.610678 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:39:47.610678 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:39:47.610678 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:39:47.610678 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:39:47.610678 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 could not be found. May 23 12:39:47.610678 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:47.610678 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:39:47.610678 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:47.610678 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:39:47.610678 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:39:47.610678 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:39:47.610678 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:39:47.610678 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:39:47.610678 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 could not be found. May 23 12:39:47.610678 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:47.611770 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-44d9ca53-ed3b-4731-b06d-04c46609007f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] Returning 404 to user: Instance 9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 could not be found. {{(pid=124200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:39:47.611770 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-44d9ca53-ed3b-4731-b06d-04c46609007f tempest-AttachVolumeNegativeTest-2053273606 tempest-AttachVolumeNegativeTest-2053273606-project] 10.222.0.16 "GET /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5" status: 404 len: 111 microversion: 2.1 time: 0.029451 May 23 12:39:47.611770 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 397/782] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:47 2022] GET /compute/v2.1/servers/9d08fb1f-a3c7-4fd2-9eec-0558f15dafa5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 12:39:47.617583 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-156aebdd-f6b0-44ac-ab79-aebd49414b89 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:47.625574 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-156aebdd-f6b0-44ac-ab79-aebd49414b89 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:47.627064 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-156aebdd-f6b0-44ac-ab79-aebd49414b89 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:47.628342 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-156aebdd-f6b0-44ac-ab79-aebd49414b89 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.169254 May 23 12:39:47.628821 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 386/783] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:39:47 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:39:47.933742 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-4d82fe9e-1086-4624-bb31-b2002bd72142 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:47.934350 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-4d82fe9e-1086-4624-bb31-b2002bd72142 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:47.940366 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4d82fe9e-1086-4624-bb31-b2002bd72142 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:47.940850 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4d82fe9e-1086-4624-bb31-b2002bd72142 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:47.941629 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4d82fe9e-1086-4624-bb31-b2002bd72142 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:47.942246 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4d82fe9e-1086-4624-bb31-b2002bd72142 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:48.064750 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-82524852-c209-48ba-8a95-d132430a83b0 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:48.065331 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-82524852-c209-48ba-8a95-d132430a83b0 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:48.072822 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-82524852-c209-48ba-8a95-d132430a83b0 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:48.073374 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-82524852-c209-48ba-8a95-d132430a83b0 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:48.074236 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-82524852-c209-48ba-8a95-d132430a83b0 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:48.074755 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-82524852-c209-48ba-8a95-d132430a83b0 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:48.089773 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.wsgi [None req-82524852-c209-48ba-8a95-d132430a83b0 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] HTTP exception thrown: Instance 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e could not be found. May 23 12:39:48.090739 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-4d82fe9e-1086-4624-bb31-b2002bd72142 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:48.091371 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-82524852-c209-48ba-8a95-d132430a83b0 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Request method failure captured: May 23 12:39:48.091371 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: request: DELETE /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e HTTP/1.1 May 23 12:39:48.091371 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept: application/json May 23 12:39:48.091371 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept-Encoding: identity May 23 12:39:48.091371 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Connection: close May 23 12:39:48.091371 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Length: 0 May 23 12:39:48.091371 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Type: application/json May 23 12:39:48.091371 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Host: 10.222.0.16 May 23 12:39:48.091371 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Openstack-System-Scope: None May 23 12:39:48.091371 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: User-Agent: python-urllib3/1.26.9 May 23 12:39:48.091371 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Auth-Token: gAAAAABii38aXdKGMOEVZ2spEcutkaQ86Yc_NLCUbMHOXXQH8Bm8w2vzfmASCK0LDJk-Hh7hHX90aFsUsBLdB-dTHGD9i7_ibWA6MXmnHMUtHbJnyrAFrC09GqDvy-mdyJpa7IcS6ayZUQlOhJ_hIkrPICcxCi1iE5fq6VI-EmRi6tTe7pQxsRo May 23 12:39:48.091371 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Id: None May 23 12:39:48.091371 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Name: None May 23 12:39:48.091371 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Identity-Status: Confirmed May 23 12:39:48.091371 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Is-Admin-Project: True May 23 12:39:48.091371 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Id: default May 23 12:39:48.091371 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Name: Default May 23 12:39:48.091371 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Id: 736376830ed340b2aa62c455c134c4e2 May 23 12:39:48.091371 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Name: tempest-AttachVolumeTestJSON-2113320926 May 23 12:39:48.091371 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Role: member,reader May 23 12:39:48.091371 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Roles: member,reader May 23 12:39:48.092882 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/736376830ed340b2aa62c455c134c4e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/736376830ed340b2aa62c455c134c4e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_736376830ed340b2aa62c455c134c4e2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/736376830ed340b2aa62c455c134c4e2"}]}] May 23 12:39:48.092882 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant: tempest-AttachVolumeTestJSON-2113320926 May 23 12:39:48.092882 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Id: 736376830ed340b2aa62c455c134c4e2 May 23 12:39:48.092882 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2113320926 May 23 12:39:48.092882 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User: tempest-AttachVolumeTestJSON-2113320926-project May 23 12:39:48.092882 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Id: default May 23 12:39:48.092882 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Name: Default May 23 12:39:48.092882 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Id: 771d3e22beff44f7bbc3103fd75a35b4 May 23 12:39:48.092882 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Name: tempest-AttachVolumeTestJSON-2113320926-project May 23 12:39:48.092882 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: method: > May 23 12:39:48.092882 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: exception: Instance 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e could not be found. May 23 12:39:48.092882 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: action_args: {'id': '380a99e6-38d9-4af6-9fa8-5506a0ffcf5e'} May 23 12:39:48.096585 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:39:48.096585 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:39:48.096585 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:39:48.096585 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:39:48.096585 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:39:48.096585 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:39:48.096585 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:39:48.096585 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:39:48.096585 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:39:48.096585 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:39:48.096585 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e could not be found. May 23 12:39:48.096585 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:39:48.096585 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:39:48.096585 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:39:48.096585 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:39:48.096585 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:39:48.096585 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:39:48.096585 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:39:48.096585 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:39:48.096585 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:39:48.098173 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:39:48.098173 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 12:39:48.098173 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 12:39:48.098173 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 12:39:48.098173 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 12:39:48.098173 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:39:48.098173 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:39:48.098173 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:39:48.098173 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:39:48.098173 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e could not be found. May 23 12:39:48.098173 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:39:48.098173 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:39:48.098173 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:39:48.098173 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:39:48.098173 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:39:48.098173 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:39:48.098173 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:39:48.098173 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:39:48.098173 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e could not be found. May 23 12:39:48.098173 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:39:48.099688 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-82524852-c209-48ba-8a95-d132430a83b0 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Returning 404 to user: Instance 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e could not be found. {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:39:48.099688 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-82524852-c209-48ba-8a95-d132430a83b0 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "DELETE /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 404 len: 111 microversion: 2.1 time: 0.031937 May 23 12:39:48.099688 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 387/784] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 12:39:48 2022] DELETE /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 12:39:48.102385 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-77983c29-0da7-487f-a498-c39769c09de5 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:48.103002 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-77983c29-0da7-487f-a498-c39769c09de5 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] [instance: 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:48.104327 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-4d82fe9e-1086-4624-bb31-b2002bd72142 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1562 microversion: 2.1 time: 0.174441 May 23 12:39:48.105030 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 398/785] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:47 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1562 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:39:48.109132 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-77983c29-0da7-487f-a498-c39769c09de5 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:48.109598 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-77983c29-0da7-487f-a498-c39769c09de5 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:48.110379 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-77983c29-0da7-487f-a498-c39769c09de5 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:48.110822 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-77983c29-0da7-487f-a498-c39769c09de5 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:48.127753 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.wsgi [None req-77983c29-0da7-487f-a498-c39769c09de5 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] HTTP exception thrown: Instance 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e could not be found. May 23 12:39:48.130000 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-77983c29-0da7-487f-a498-c39769c09de5 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Request method failure captured: May 23 12:39:48.130000 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: request: GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e HTTP/1.1 May 23 12:39:48.130000 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept: application/json May 23 12:39:48.130000 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept-Encoding: identity May 23 12:39:48.130000 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Connection: close May 23 12:39:48.130000 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Length: 0 May 23 12:39:48.130000 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Type: application/json May 23 12:39:48.130000 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Host: 10.222.0.16 May 23 12:39:48.130000 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Openstack-System-Scope: None May 23 12:39:48.130000 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: User-Agent: python-urllib3/1.26.9 May 23 12:39:48.130000 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Auth-Token: gAAAAABii38aXdKGMOEVZ2spEcutkaQ86Yc_NLCUbMHOXXQH8Bm8w2vzfmASCK0LDJk-Hh7hHX90aFsUsBLdB-dTHGD9i7_ibWA6MXmnHMUtHbJnyrAFrC09GqDvy-mdyJpa7IcS6ayZUQlOhJ_hIkrPICcxCi1iE5fq6VI-EmRi6tTe7pQxsRo May 23 12:39:48.130000 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Id: None May 23 12:39:48.130000 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Name: None May 23 12:39:48.130000 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Identity-Status: Confirmed May 23 12:39:48.130000 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Is-Admin-Project: True May 23 12:39:48.130000 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Id: default May 23 12:39:48.130000 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Name: Default May 23 12:39:48.130000 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Id: 736376830ed340b2aa62c455c134c4e2 May 23 12:39:48.130000 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Name: tempest-AttachVolumeTestJSON-2113320926 May 23 12:39:48.130000 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Role: member,reader May 23 12:39:48.130000 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Roles: member,reader May 23 12:39:48.131803 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/736376830ed340b2aa62c455c134c4e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/736376830ed340b2aa62c455c134c4e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_736376830ed340b2aa62c455c134c4e2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/736376830ed340b2aa62c455c134c4e2"}]}] May 23 12:39:48.131803 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant: tempest-AttachVolumeTestJSON-2113320926 May 23 12:39:48.131803 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Id: 736376830ed340b2aa62c455c134c4e2 May 23 12:39:48.131803 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2113320926 May 23 12:39:48.131803 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User: tempest-AttachVolumeTestJSON-2113320926-project May 23 12:39:48.131803 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Id: default May 23 12:39:48.131803 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Name: Default May 23 12:39:48.131803 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Id: 771d3e22beff44f7bbc3103fd75a35b4 May 23 12:39:48.131803 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Name: tempest-AttachVolumeTestJSON-2113320926-project May 23 12:39:48.131803 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: method: > May 23 12:39:48.131803 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: exception: Instance 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e could not be found. May 23 12:39:48.131803 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: action_args: {'id': '380a99e6-38d9-4af6-9fa8-5506a0ffcf5e'} May 23 12:39:48.132729 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:39:48.132729 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:39:48.132729 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:39:48.132729 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:39:48.132729 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:39:48.132729 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:39:48.132729 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:39:48.132729 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:39:48.132729 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:39:48.132729 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:39:48.132729 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e could not be found. May 23 12:39:48.132729 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:39:48.132729 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:39:48.132729 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:39:48.132729 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:39:48.132729 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:39:48.132729 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:39:48.132729 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:39:48.132729 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:39:48.132729 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:39:48.134091 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:39:48.134091 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:39:48.134091 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:39:48.134091 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:39:48.134091 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:39:48.134091 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:39:48.134091 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:39:48.134091 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e could not be found. May 23 12:39:48.134091 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:39:48.134091 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:39:48.134091 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:39:48.134091 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:39:48.134091 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:39:48.134091 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:39:48.134091 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:39:48.134091 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:39:48.134091 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e could not be found. May 23 12:39:48.134091 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:39:48.135353 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-77983c29-0da7-487f-a498-c39769c09de5 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] Returning 404 to user: Instance 380a99e6-38d9-4af6-9fa8-5506a0ffcf5e could not be found. {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:39:48.135353 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-77983c29-0da7-487f-a498-c39769c09de5 tempest-AttachVolumeTestJSON-2113320926 tempest-AttachVolumeTestJSON-2113320926-project] 10.222.0.16 "GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e" status: 404 len: 111 microversion: 2.1 time: 0.033809 May 23 12:39:48.135353 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 388/786] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:39:48 2022] GET /compute/v2.1/servers/380a99e6-38d9-4af6-9fa8-5506a0ffcf5e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:39:48.650736 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-c8d6db93-9fa3-4fd2-aed6-4518577da044 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:48.651490 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-c8d6db93-9fa3-4fd2-aed6-4518577da044 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:48.659955 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c8d6db93-9fa3-4fd2-aed6-4518577da044 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:48.664887 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c8d6db93-9fa3-4fd2-aed6-4518577da044 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:48.665854 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c8d6db93-9fa3-4fd2-aed6-4518577da044 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:48.666384 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c8d6db93-9fa3-4fd2-aed6-4518577da044 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:48.947390 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-c8d6db93-9fa3-4fd2-aed6-4518577da044 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:48.960354 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-c8d6db93-9fa3-4fd2-aed6-4518577da044 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:48.961941 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-c8d6db93-9fa3-4fd2-aed6-4518577da044 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:48.966373 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-c8d6db93-9fa3-4fd2-aed6-4518577da044 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.320032 May 23 12:39:48.967576 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 399/787] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:39:48 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:39:49.988140 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-8bf0e4c1-2191-419a-a26c-c0682e1bd252 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:49.989197 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-8bf0e4c1-2191-419a-a26c-c0682e1bd252 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:50.002903 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8bf0e4c1-2191-419a-a26c-c0682e1bd252 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:50.007520 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8bf0e4c1-2191-419a-a26c-c0682e1bd252 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:50.008755 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8bf0e4c1-2191-419a-a26c-c0682e1bd252 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:50.009215 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8bf0e4c1-2191-419a-a26c-c0682e1bd252 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:50.695522 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-8bf0e4c1-2191-419a-a26c-c0682e1bd252 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:50.705273 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-8bf0e4c1-2191-419a-a26c-c0682e1bd252 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:50.706789 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-8bf0e4c1-2191-419a-a26c-c0682e1bd252 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:50.708289 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-8bf0e4c1-2191-419a-a26c-c0682e1bd252 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1745 microversion: 2.20 time: 0.725245 May 23 12:39:50.720044 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 389/788] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:39:49 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1745 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:39:51.728780 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-a4ef2fe2-435e-466a-9f9c-d13cde503c80 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:51.729626 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-a4ef2fe2-435e-466a-9f9c-d13cde503c80 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:51.750155 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a4ef2fe2-435e-466a-9f9c-d13cde503c80 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:51.755818 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a4ef2fe2-435e-466a-9f9c-d13cde503c80 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:51.762749 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a4ef2fe2-435e-466a-9f9c-d13cde503c80 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:51.763618 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a4ef2fe2-435e-466a-9f9c-d13cde503c80 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:51.991187 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-a4ef2fe2-435e-466a-9f9c-d13cde503c80 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:52.002976 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-a4ef2fe2-435e-466a-9f9c-d13cde503c80 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:52.007263 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-a4ef2fe2-435e-466a-9f9c-d13cde503c80 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:52.008659 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-a4ef2fe2-435e-466a-9f9c-d13cde503c80 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1740 microversion: 2.20 time: 0.285573 May 23 12:39:52.022628 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 400/789] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:39:51 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1740 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:39:52.928710 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-26fad95f-1783-4858-b416-4a7cc5127e7d req-b20aa72d-3fbd-468f-a977-36a62c01e140 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40320b2c-6137-4266-b3b6-fb76f3d6d654", "name": "network-vif-plugged", "status": "completed", "tag": "c581b4f8-de6e-4314-a04e-aca7063e49e5"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:39:52.946777 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-26fad95f-1783-4858-b416-4a7cc5127e7d req-b20aa72d-3fbd-468f-a977-36a62c01e140 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:52.950072 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-26fad95f-1783-4858-b416-4a7cc5127e7d req-b20aa72d-3fbd-468f-a977-36a62c01e140 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:52.983490 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-26fad95f-1783-4858-b416-4a7cc5127e7d req-b20aa72d-3fbd-468f-a977-36a62c01e140 service nova] Creating event network-vif-plugged:c581b4f8-de6e-4314-a04e-aca7063e49e5 for instance 40320b2c-6137-4266-b3b6-fb76f3d6d654 on hv-cinder-83699 May 23 12:39:52.995897 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-26fad95f-1783-4858-b416-4a7cc5127e7d req-b20aa72d-3fbd-468f-a977-36a62c01e140 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071352 May 23 12:39:52.999089 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 390/790] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:39:53.047790 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-54c2fc5c-848c-4978-a19e-a1c7d1fa1df7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:53.049205 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-54c2fc5c-848c-4978-a19e-a1c7d1fa1df7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:53.062750 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-54c2fc5c-848c-4978-a19e-a1c7d1fa1df7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:53.065172 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-54c2fc5c-848c-4978-a19e-a1c7d1fa1df7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:53.069312 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-54c2fc5c-848c-4978-a19e-a1c7d1fa1df7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:53.076882 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-54c2fc5c-848c-4978-a19e-a1c7d1fa1df7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:53.357110 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-54c2fc5c-848c-4978-a19e-a1c7d1fa1df7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:53.373588 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-54c2fc5c-848c-4978-a19e-a1c7d1fa1df7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:53.377256 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-54c2fc5c-848c-4978-a19e-a1c7d1fa1df7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:53.378539 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-54c2fc5c-848c-4978-a19e-a1c7d1fa1df7 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1740 microversion: 2.20 time: 0.337076 May 23 12:39:53.382246 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 401/791] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:39:53 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1740 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:39:54.399390 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-a801767b-e8f4-4cfe-9c52-618890bd8607 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:54.400752 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-a801767b-e8f4-4cfe-9c52-618890bd8607 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:54.411043 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a801767b-e8f4-4cfe-9c52-618890bd8607 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:54.412143 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a801767b-e8f4-4cfe-9c52-618890bd8607 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:54.413369 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a801767b-e8f4-4cfe-9c52-618890bd8607 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:54.413875 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a801767b-e8f4-4cfe-9c52-618890bd8607 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:54.648560 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-a801767b-e8f4-4cfe-9c52-618890bd8607 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:54.658298 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-a801767b-e8f4-4cfe-9c52-618890bd8607 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:54.660109 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-a801767b-e8f4-4cfe-9c52-618890bd8607 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:54.663354 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-a801767b-e8f4-4cfe-9c52-618890bd8607 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1740 microversion: 2.20 time: 0.269740 May 23 12:39:54.664154 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 391/792] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:39:54 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1740 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:39:54.959751 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-29a77e88-ab6d-40bb-98a1-46f50c36356a tempest-VolumesGetTestJSON-379044312 tempest-VolumesGetTestJSON-379044312-project] Action: 'create', calling method: .version_select at 0x7f095c9ee160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-854725555", "metadata": {"Type": "work"}}} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:39:55.355126 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-29a77e88-ab6d-40bb-98a1-46f50c36356a tempest-VolumesGetTestJSON-379044312 tempest-VolumesGetTestJSON-379044312-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.554980 May 23 12:39:55.362305 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 402/793] 10.222.0.16 () {60 vars in 1155 bytes} [Mon May 23 12:39:54 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 563 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 23 12:39:55.368440 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-10df9476-eefa-4bed-aea7-1891b295a529 tempest-VolumesGetTestJSON-379044312 tempest-VolumesGetTestJSON-379044312-project] Calling method '.version_select at 0x7f095d2093a0>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:55.454998 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-10df9476-eefa-4bed-aea7-1891b295a529 tempest-VolumesGetTestJSON-379044312 tempest-VolumesGetTestJSON-379044312-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/9a161da5-9044-452a-bf44-13bf804ce127" status: 200 len: 352 microversion: 2.1 time: 0.091320 May 23 12:39:55.455730 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 392/794] 10.222.0.16 () {58 vars in 1244 bytes} [Mon May 23 12:39:55 2022] GET /compute/v2.1/os-volumes/9a161da5-9044-452a-bf44-13bf804ce127 => generated 352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:39:55.683952 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-48ed61bf-8996-405d-98ae-81bb63795daa tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:55.685043 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-48ed61bf-8996-405d-98ae-81bb63795daa tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:55.692843 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-48ed61bf-8996-405d-98ae-81bb63795daa tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:55.693716 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-48ed61bf-8996-405d-98ae-81bb63795daa tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:55.694903 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-48ed61bf-8996-405d-98ae-81bb63795daa tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:55.695711 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-48ed61bf-8996-405d-98ae-81bb63795daa tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:55.873297 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-48ed61bf-8996-405d-98ae-81bb63795daa tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:55.890428 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-48ed61bf-8996-405d-98ae-81bb63795daa tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:55.892319 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-48ed61bf-8996-405d-98ae-81bb63795daa tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:55.893656 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-48ed61bf-8996-405d-98ae-81bb63795daa tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1740 microversion: 2.20 time: 0.214779 May 23 12:39:55.894277 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 403/795] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:39:55 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1740 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:39:56.470520 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b861cb2f-b0ed-48f2-8534-2d246ebca9c3 tempest-VolumesGetTestJSON-379044312 tempest-VolumesGetTestJSON-379044312-project] Calling method '.version_select at 0x7f095d0ae8b0>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:56.551003 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b861cb2f-b0ed-48f2-8534-2d246ebca9c3 tempest-VolumesGetTestJSON-379044312 tempest-VolumesGetTestJSON-379044312-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/9a161da5-9044-452a-bf44-13bf804ce127" status: 200 len: 352 microversion: 2.1 time: 0.086270 May 23 12:39:56.551529 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 393/796] 10.222.0.16 () {58 vars in 1244 bytes} [Mon May 23 12:39:56 2022] GET /compute/v2.1/os-volumes/9a161da5-9044-452a-bf44-13bf804ce127 => generated 352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:39:56.918060 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-9515f1a2-26cf-4401-a12a-e976313b25b1 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:56.921127 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-9515f1a2-26cf-4401-a12a-e976313b25b1 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:56.947177 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9515f1a2-26cf-4401-a12a-e976313b25b1 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:56.949165 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9515f1a2-26cf-4401-a12a-e976313b25b1 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:56.950048 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9515f1a2-26cf-4401-a12a-e976313b25b1 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:56.950692 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9515f1a2-26cf-4401-a12a-e976313b25b1 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:57.176997 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-9515f1a2-26cf-4401-a12a-e976313b25b1 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:57.198448 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-9515f1a2-26cf-4401-a12a-e976313b25b1 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:57.213898 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-9515f1a2-26cf-4401-a12a-e976313b25b1 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:57.218751 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-9515f1a2-26cf-4401-a12a-e976313b25b1 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1740 microversion: 2.20 time: 0.308966 May 23 12:39:57.227321 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 404/797] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:39:56 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1740 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:39:57.563030 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-bb3b5f80-cb02-43e3-b5ce-34e076b92e6c tempest-VolumesGetTestJSON-379044312 tempest-VolumesGetTestJSON-379044312-project] Calling method '.version_select at 0x7f095d2ccca0>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:57.653968 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-bb3b5f80-cb02-43e3-b5ce-34e076b92e6c tempest-VolumesGetTestJSON-379044312 tempest-VolumesGetTestJSON-379044312-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/9a161da5-9044-452a-bf44-13bf804ce127" status: 200 len: 353 microversion: 2.1 time: 0.094563 May 23 12:39:57.655258 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 394/798] 10.222.0.16 () {58 vars in 1244 bytes} [Mon May 23 12:39:57 2022] GET /compute/v2.1/os-volumes/9a161da5-9044-452a-bf44-13bf804ce127 => generated 353 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:39:57.669230 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-99eb32de-45fe-4ac2-bb6d-d3e286f3532b tempest-VolumesGetTestJSON-379044312 tempest-VolumesGetTestJSON-379044312-project] Calling method '.version_select at 0x7f095c9ee3a0>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:57.741508 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-99eb32de-45fe-4ac2-bb6d-d3e286f3532b tempest-VolumesGetTestJSON-379044312 tempest-VolumesGetTestJSON-379044312-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/9a161da5-9044-452a-bf44-13bf804ce127" status: 200 len: 353 microversion: 2.1 time: 0.077172 May 23 12:39:57.758272 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-94daa652-5811-410f-bd62-2bf497aa91a9 tempest-VolumesGetTestJSON-379044312 tempest-VolumesGetTestJSON-379044312-project] Calling method '.version_select at 0x7f095d2093a0>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:57.760532 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 405/799] 10.222.0.16 () {58 vars in 1244 bytes} [Mon May 23 12:39:57 2022] GET /compute/v2.1/os-volumes/9a161da5-9044-452a-bf44-13bf804ce127 => generated 353 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:39:57.842906 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-94daa652-5811-410f-bd62-2bf497aa91a9 tempest-VolumesGetTestJSON-379044312 tempest-VolumesGetTestJSON-379044312-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/9a161da5-9044-452a-bf44-13bf804ce127" status: 202 len: 0 microversion: 2.1 time: 0.088862 May 23 12:39:57.853021 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 395/800] 10.222.0.16 () {58 vars in 1247 bytes} [Mon May 23 12:39:57 2022] DELETE /compute/v2.1/os-volumes/9a161da5-9044-452a-bf44-13bf804ce127 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:39:57.855360 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-a316e69f-a92b-4b5c-97c6-f9321d662279 tempest-VolumesGetTestJSON-379044312 tempest-VolumesGetTestJSON-379044312-project] Calling method '.version_select at 0x7f095c88fdc0>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:57.926007 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-a316e69f-a92b-4b5c-97c6-f9321d662279 tempest-VolumesGetTestJSON-379044312 tempest-VolumesGetTestJSON-379044312-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/9a161da5-9044-452a-bf44-13bf804ce127" status: 200 len: 352 microversion: 2.1 time: 0.077378 May 23 12:39:57.932035 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 406/801] 10.222.0.16 () {58 vars in 1244 bytes} [Mon May 23 12:39:57 2022] GET /compute/v2.1/os-volumes/9a161da5-9044-452a-bf44-13bf804ce127 => generated 352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:39:58.248953 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-8376f615-6092-4ea5-8ba5-d23314bf9217 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:58.249833 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-8376f615-6092-4ea5-8ba5-d23314bf9217 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:58.262131 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8376f615-6092-4ea5-8ba5-d23314bf9217 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:58.263647 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8376f615-6092-4ea5-8ba5-d23314bf9217 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:58.264700 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8376f615-6092-4ea5-8ba5-d23314bf9217 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:58.268935 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8376f615-6092-4ea5-8ba5-d23314bf9217 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:58.490960 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-8376f615-6092-4ea5-8ba5-d23314bf9217 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:58.502085 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-8376f615-6092-4ea5-8ba5-d23314bf9217 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:58.504490 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-8376f615-6092-4ea5-8ba5-d23314bf9217 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:58.505751 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-8376f615-6092-4ea5-8ba5-d23314bf9217 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1740 microversion: 2.20 time: 0.260987 May 23 12:39:58.506302 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 396/802] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:39:58 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1740 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:39:58.942586 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-bfe11e2f-0493-49e0-ab16-c5638006fdc8 tempest-VolumesGetTestJSON-379044312 tempest-VolumesGetTestJSON-379044312-project] Calling method '.version_select at 0x7f095ca448b0>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:59.003090 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.wsgi [None req-bfe11e2f-0493-49e0-ab16-c5638006fdc8 tempest-VolumesGetTestJSON-379044312 tempest-VolumesGetTestJSON-379044312-project] HTTP exception thrown: Volume 9a161da5-9044-452a-bf44-13bf804ce127 could not be found. May 23 12:39:59.005759 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-bfe11e2f-0493-49e0-ab16-c5638006fdc8 tempest-VolumesGetTestJSON-379044312 tempest-VolumesGetTestJSON-379044312-project] Request method failure captured: May 23 12:39:59.005759 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: request: GET /compute/v2.1/os-volumes/9a161da5-9044-452a-bf44-13bf804ce127 HTTP/1.1 May 23 12:39:59.005759 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept: application/json May 23 12:39:59.005759 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept-Encoding: identity May 23 12:39:59.005759 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Connection: close May 23 12:39:59.005759 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Length: 0 May 23 12:39:59.005759 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Type: application/json May 23 12:39:59.005759 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Host: 10.222.0.16 May 23 12:39:59.005759 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Openstack-System-Scope: None May 23 12:39:59.005759 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: User-Agent: python-urllib3/1.26.9 May 23 12:39:59.005759 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Auth-Token: gAAAAABii4CaUA-SS8I2s-EnI54vyoiXFBeIRON1n-iTZUTbGE49JYqN3iDl3Rh0ltIuC9uvQuhWaBPQbvixmz1j0g5BS-ywColhkXnKyo1AqHqArMtcsJasWFomcM7RNf6loBxuWbigLAihybSxzJ2Ozdb6wI1YOZGXmNIULUjQ-PXwpECoXt4 May 23 12:39:59.005759 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Id: None May 23 12:39:59.005759 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Name: None May 23 12:39:59.005759 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Identity-Status: Confirmed May 23 12:39:59.005759 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Is-Admin-Project: True May 23 12:39:59.005759 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Id: default May 23 12:39:59.005759 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Name: Default May 23 12:39:59.005759 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Id: 3405fd7245fc467ea1938f9251662f0d May 23 12:39:59.005759 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Name: tempest-VolumesGetTestJSON-379044312 May 23 12:39:59.005759 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Role: member,reader May 23 12:39:59.005759 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Roles: member,reader May 23 12:39:59.007660 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3405fd7245fc467ea1938f9251662f0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3405fd7245fc467ea1938f9251662f0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3405fd7245fc467ea1938f9251662f0d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3405fd7245fc467ea1938f9251662f0d"}]}] May 23 12:39:59.007660 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant: tempest-VolumesGetTestJSON-379044312 May 23 12:39:59.007660 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Id: 3405fd7245fc467ea1938f9251662f0d May 23 12:39:59.007660 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Name: tempest-VolumesGetTestJSON-379044312 May 23 12:39:59.007660 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User: tempest-VolumesGetTestJSON-379044312-project May 23 12:39:59.007660 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Id: default May 23 12:39:59.007660 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Name: Default May 23 12:39:59.007660 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Id: 7ea2ed0a883248948c47f188c54bd42a May 23 12:39:59.007660 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Name: tempest-VolumesGetTestJSON-379044312-project May 23 12:39:59.007660 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: method: May 23 12:39:59.007660 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: exception: Volume 9a161da5-9044-452a-bf44-13bf804ce127 could not be found. May 23 12:39:59.007660 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: action_args: {'id': '9a161da5-9044-452a-bf44-13bf804ce127'} May 23 12:39:59.007660 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:39:59.008778 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:39:59.008778 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 12:39:59.008778 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 12:39:59.008778 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 12:39:59.008778 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 12:39:59.008778 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 12:39:59.008778 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 12:39:59.008778 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 12:39:59.008778 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 12:39:59.008778 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 12:39:59.008778 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 12:39:59.008778 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 12:39:59.008778 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 12:39:59.008778 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 12:39:59.008778 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 12:39:59.008778 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9a161da5-9044-452a-bf44-13bf804ce127 could not be found. (HTTP 404) (Request-ID: req-fae77e7a-c363-499c-884e-28fe93af4241) May 23 12:39:59.008778 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:59.008778 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:39:59.008778 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:59.011710 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:39:59.011710 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 23 12:39:59.011710 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 23 12:39:59.011710 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 12:39:59.011710 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 12:39:59.011710 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 12:39:59.011710 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 12:39:59.011710 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 12:39:59.011710 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 12:39:59.011710 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 12:39:59.011710 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 12:39:59.011710 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 12:39:59.011710 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 12:39:59.011710 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 12:39:59.011710 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 12:39:59.011710 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 12:39:59.011710 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 12:39:59.011710 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 12:39:59.011710 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 12:39:59.013392 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 12:39:59.013392 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 12:39:59.013392 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 12:39:59.013392 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 12:39:59.013392 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9a161da5-9044-452a-bf44-13bf804ce127 could not be found. May 23 12:39:59.013392 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:59.013392 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:39:59.013392 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:59.013392 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:39:59.013392 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:39:59.013392 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:39:59.013392 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:39:59.013392 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:39:59.013392 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 12:39:59.013392 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 12:39:59.013392 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:39:59.013392 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:39:59.013392 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 23 12:39:59.013392 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:39:59.015142 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9a161da5-9044-452a-bf44-13bf804ce127 could not be found. May 23 12:39:59.015142 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:59.015142 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:39:59.015142 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:59.015142 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:39:59.015142 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:39:59.015142 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:39:59.015142 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:39:59.015142 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:39:59.015142 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9a161da5-9044-452a-bf44-13bf804ce127 could not be found. May 23 12:39:59.015142 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:39:59.015142 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-bfe11e2f-0493-49e0-ab16-c5638006fdc8 tempest-VolumesGetTestJSON-379044312 tempest-VolumesGetTestJSON-379044312-project] Returning 404 to user: Volume 9a161da5-9044-452a-bf44-13bf804ce127 could not be found. {{(pid=124200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:39:59.015142 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-bfe11e2f-0493-49e0-ab16-c5638006fdc8 tempest-VolumesGetTestJSON-379044312 tempest-VolumesGetTestJSON-379044312-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/9a161da5-9044-452a-bf44-13bf804ce127" status: 404 len: 109 microversion: 2.1 time: 0.073004 May 23 12:39:59.015142 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 407/803] 10.222.0.16 () {58 vars in 1244 bytes} [Mon May 23 12:39:58 2022] GET /compute/v2.1/os-volumes/9a161da5-9044-452a-bf44-13bf804ce127 => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:39:59.530753 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-7eeb59f5-697e-4e05-9f97-04b3dcabb6b2 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:59.535982 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-7eeb59f5-697e-4e05-9f97-04b3dcabb6b2 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:39:59.557348 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7eeb59f5-697e-4e05-9f97-04b3dcabb6b2 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:59.584920 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7eeb59f5-697e-4e05-9f97-04b3dcabb6b2 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:59.584920 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7eeb59f5-697e-4e05-9f97-04b3dcabb6b2 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:39:59.584920 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7eeb59f5-697e-4e05-9f97-04b3dcabb6b2 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:39:59.803727 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-7eeb59f5-697e-4e05-9f97-04b3dcabb6b2 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:59.813514 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-7eeb59f5-697e-4e05-9f97-04b3dcabb6b2 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:59.815616 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-7eeb59f5-697e-4e05-9f97-04b3dcabb6b2 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:39:59.817217 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-7eeb59f5-697e-4e05-9f97-04b3dcabb6b2 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1740 microversion: 2.20 time: 0.297200 May 23 12:39:59.818477 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 397/804] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:39:59 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1740 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:40:00.838264 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-47d90613-8254-45a0-b2e0-fd7946e906c9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:00.840275 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-47d90613-8254-45a0-b2e0-fd7946e906c9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:00.855158 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-47d90613-8254-45a0-b2e0-fd7946e906c9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:00.856295 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-47d90613-8254-45a0-b2e0-fd7946e906c9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:00.858241 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-47d90613-8254-45a0-b2e0-fd7946e906c9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:00.858973 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-47d90613-8254-45a0-b2e0-fd7946e906c9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:01.066228 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-47d90613-8254-45a0-b2e0-fd7946e906c9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:01.100533 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-47d90613-8254-45a0-b2e0-fd7946e906c9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:01.105616 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-47d90613-8254-45a0-b2e0-fd7946e906c9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:01.108793 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-47d90613-8254-45a0-b2e0-fd7946e906c9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1740 microversion: 2.20 time: 0.274523 May 23 12:40:01.109957 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 408/805] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:40:00 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1740 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:40:02.127903 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-926ced2b-08a2-4bd6-9bda-56cfd97dba43 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:02.128545 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-926ced2b-08a2-4bd6-9bda-56cfd97dba43 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:02.137217 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-926ced2b-08a2-4bd6-9bda-56cfd97dba43 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:02.137672 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-926ced2b-08a2-4bd6-9bda-56cfd97dba43 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:02.138450 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-926ced2b-08a2-4bd6-9bda-56cfd97dba43 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:02.138888 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-926ced2b-08a2-4bd6-9bda-56cfd97dba43 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:02.156542 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell1:SELECT=100 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:40:02.296990 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-926ced2b-08a2-4bd6-9bda-56cfd97dba43 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:02.309401 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-926ced2b-08a2-4bd6-9bda-56cfd97dba43 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:02.310954 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-926ced2b-08a2-4bd6-9bda-56cfd97dba43 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:02.312338 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-926ced2b-08a2-4bd6-9bda-56cfd97dba43 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1740 microversion: 2.20 time: 0.188407 May 23 12:40:02.312992 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 398/806] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:40:02 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:40:03.338041 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-63d44145-39fd-41c3-ad5a-f3960f48570d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:03.338041 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-63d44145-39fd-41c3-ad5a-f3960f48570d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:03.345189 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-63d44145-39fd-41c3-ad5a-f3960f48570d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:03.345684 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-63d44145-39fd-41c3-ad5a-f3960f48570d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:03.346825 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-63d44145-39fd-41c3-ad5a-f3960f48570d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:03.347288 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-63d44145-39fd-41c3-ad5a-f3960f48570d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:03.532640 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-63d44145-39fd-41c3-ad5a-f3960f48570d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:03.541959 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-63d44145-39fd-41c3-ad5a-f3960f48570d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:03.543481 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-63d44145-39fd-41c3-ad5a-f3960f48570d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:03.557757 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-63d44145-39fd-41c3-ad5a-f3960f48570d tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1740 microversion: 2.20 time: 0.224966 May 23 12:40:03.558380 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 409/807] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:40:03 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1740 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:40:04.583029 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-e2c5364d-1c0c-47cb-a6c4-ea8a03996877 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:04.583029 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-e2c5364d-1c0c-47cb-a6c4-ea8a03996877 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:04.596211 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e2c5364d-1c0c-47cb-a6c4-ea8a03996877 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:04.597039 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e2c5364d-1c0c-47cb-a6c4-ea8a03996877 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:04.598966 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e2c5364d-1c0c-47cb-a6c4-ea8a03996877 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:04.599758 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e2c5364d-1c0c-47cb-a6c4-ea8a03996877 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:04.921806 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-e2c5364d-1c0c-47cb-a6c4-ea8a03996877 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:04.947421 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-e2c5364d-1c0c-47cb-a6c4-ea8a03996877 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:04.950195 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-e2c5364d-1c0c-47cb-a6c4-ea8a03996877 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:04.951744 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-e2c5364d-1c0c-47cb-a6c4-ea8a03996877 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1740 microversion: 2.20 time: 0.378412 May 23 12:40:04.952354 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 399/808] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:40:04 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1740 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:40:05.977848 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-6a138fec-2594-4435-8adb-25acc4c82bf5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:05.979042 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-6a138fec-2594-4435-8adb-25acc4c82bf5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:05.985934 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6a138fec-2594-4435-8adb-25acc4c82bf5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:05.986388 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6a138fec-2594-4435-8adb-25acc4c82bf5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:05.987164 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6a138fec-2594-4435-8adb-25acc4c82bf5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:05.987599 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6a138fec-2594-4435-8adb-25acc4c82bf5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:06.168369 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-6a138fec-2594-4435-8adb-25acc4c82bf5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:06.178044 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-6a138fec-2594-4435-8adb-25acc4c82bf5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:06.179791 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-6a138fec-2594-4435-8adb-25acc4c82bf5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:06.181187 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-6a138fec-2594-4435-8adb-25acc4c82bf5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1722 microversion: 2.20 time: 0.207542 May 23 12:40:06.181969 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 410/809] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:40:05 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1722 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:40:07.202859 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-bd12d1c5-b1ad-439e-929c-42ee33cb012a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:07.204135 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-bd12d1c5-b1ad-439e-929c-42ee33cb012a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:07.210164 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=1 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:40:07.217378 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bd12d1c5-b1ad-439e-929c-42ee33cb012a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:07.217922 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bd12d1c5-b1ad-439e-929c-42ee33cb012a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:07.218859 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bd12d1c5-b1ad-439e-929c-42ee33cb012a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:07.219524 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bd12d1c5-b1ad-439e-929c-42ee33cb012a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:07.497150 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-bd12d1c5-b1ad-439e-929c-42ee33cb012a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:07.520443 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-bd12d1c5-b1ad-439e-929c-42ee33cb012a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:07.522113 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-bd12d1c5-b1ad-439e-929c-42ee33cb012a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:07.524218 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-bd12d1c5-b1ad-439e-929c-42ee33cb012a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1722 microversion: 2.20 time: 0.326653 May 23 12:40:07.525195 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 400/810] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:40:07 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1722 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:40:08.544617 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-60d6d601-ca5b-48b5-ac32-d77bcb8f73e5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:08.545228 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-60d6d601-ca5b-48b5-ac32-d77bcb8f73e5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:08.554473 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-60d6d601-ca5b-48b5-ac32-d77bcb8f73e5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:08.555269 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-60d6d601-ca5b-48b5-ac32-d77bcb8f73e5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:08.556123 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-60d6d601-ca5b-48b5-ac32-d77bcb8f73e5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:08.556813 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-60d6d601-ca5b-48b5-ac32-d77bcb8f73e5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:08.632352 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-5c4fcae6-d08f-4860-bff9-ecf052113b22 req-25d77fd3-8c67-4144-8045-c72e3db4b419 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40320b2c-6137-4266-b3b6-fb76f3d6d654", "name": "network-vif-unplugged", "status": "completed", "tag": "c581b4f8-de6e-4314-a04e-aca7063e49e5"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:40:08.650291 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-5c4fcae6-d08f-4860-bff9-ecf052113b22 req-25d77fd3-8c67-4144-8045-c72e3db4b419 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:08.651293 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-5c4fcae6-d08f-4860-bff9-ecf052113b22 req-25d77fd3-8c67-4144-8045-c72e3db4b419 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:08.670861 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.compute.server_external_events [req-5c4fcae6-d08f-4860-bff9-ecf052113b22 req-25d77fd3-8c67-4144-8045-c72e3db4b419 service nova] Unable to find a host for instance 40320b2c-6137-4266-b3b6-fb76f3d6d654. Dropping event network-vif-unplugged {{(pid=124199) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 23 12:40:08.679210 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-5c4fcae6-d08f-4860-bff9-ecf052113b22 req-25d77fd3-8c67-4144-8045-c72e3db4b419 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.052553 May 23 12:40:08.679975 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 401/811] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 54 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 23 12:40:08.730466 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-60d6d601-ca5b-48b5-ac32-d77bcb8f73e5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:08.744405 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-60d6d601-ca5b-48b5-ac32-d77bcb8f73e5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:08.746803 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-60d6d601-ca5b-48b5-ac32-d77bcb8f73e5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:08.748320 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-60d6d601-ca5b-48b5-ac32-d77bcb8f73e5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1665 microversion: 2.20 time: 0.207632 May 23 12:40:08.749420 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 411/812] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:40:08 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1665 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:40:08.770295 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-8ac1c717-a51c-43b5-9ab0-2c0d8e4bcdb6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e4a18f0e-309f-426a-b2e8-844d65269c2d"}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:40:08.771881 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-8ac1c717-a51c-43b5-9ab0-2c0d8e4bcdb6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:08.778144 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8ac1c717-a51c-43b5-9ab0-2c0d8e4bcdb6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:08.778562 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8ac1c717-a51c-43b5-9ab0-2c0d8e4bcdb6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:08.779600 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8ac1c717-a51c-43b5-9ab0-2c0d8e4bcdb6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:08.780358 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8ac1c717-a51c-43b5-9ab0-2c0d8e4bcdb6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:09.264137 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-8ac1c717-a51c-43b5-9ab0-2c0d8e4bcdb6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "POST /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.499173 May 23 12:40:09.264937 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 402/813] 10.222.0.16 () {62 vars in 1363 bytes} [Mon May 23 12:40:08 2022] POST /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654/os-volume_attachments => generated 188 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 12:40:09.494972 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-6211713c-2911-430a-b663-72eaa8cd3a6b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:09.495805 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-6211713c-2911-430a-b663-72eaa8cd3a6b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:09.503628 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6211713c-2911-430a-b663-72eaa8cd3a6b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:09.504757 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6211713c-2911-430a-b663-72eaa8cd3a6b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:09.505792 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6211713c-2911-430a-b663-72eaa8cd3a6b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:09.506291 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6211713c-2911-430a-b663-72eaa8cd3a6b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:09.631570 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:40:09.826471 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-6211713c-2911-430a-b663-72eaa8cd3a6b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "DELETE /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654/os-volume_attachments/e4a18f0e-309f-426a-b2e8-844d65269c2d" status: 202 len: 0 microversion: 2.20 time: 0.339424 May 23 12:40:09.827703 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 412/814] 10.222.0.16 () {60 vars in 1456 bytes} [Mon May 23 12:40:09 2022] DELETE /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654/os-volume_attachments/e4a18f0e-309f-426a-b2e8-844d65269c2d => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 23 12:40:09.895832 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-53a392d8-0c85-40ca-93d5-ffc2b9495111 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:40:09.897143 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-53a392d8-0c85-40ca-93d5-ffc2b9495111 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:09.904753 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-53a392d8-0c85-40ca-93d5-ffc2b9495111 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:09.905510 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-53a392d8-0c85-40ca-93d5-ffc2b9495111 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:09.906503 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-53a392d8-0c85-40ca-93d5-ffc2b9495111 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:09.907189 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-53a392d8-0c85-40ca-93d5-ffc2b9495111 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:10.024436 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-53a392d8-0c85-40ca-93d5-ffc2b9495111 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "POST /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654/action" status: 202 len: 0 microversion: 2.20 time: 0.131114 May 23 12:40:10.031015 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 403/815] 10.222.0.16 () {62 vars in 1318 bytes} [Mon May 23 12:40:09 2022] POST /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 23 12:40:10.046763 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-4b3046b1-99fb-4d09-8a90-011ac7ecbe9b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:10.047561 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-4b3046b1-99fb-4d09-8a90-011ac7ecbe9b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:10.062505 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4b3046b1-99fb-4d09-8a90-011ac7ecbe9b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:10.065928 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4b3046b1-99fb-4d09-8a90-011ac7ecbe9b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:10.067409 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4b3046b1-99fb-4d09-8a90-011ac7ecbe9b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:10.067825 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4b3046b1-99fb-4d09-8a90-011ac7ecbe9b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:10.264806 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-4b3046b1-99fb-4d09-8a90-011ac7ecbe9b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:10.278410 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-4b3046b1-99fb-4d09-8a90-011ac7ecbe9b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:10.281156 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-4b3046b1-99fb-4d09-8a90-011ac7ecbe9b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:10.282963 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-4b3046b1-99fb-4d09-8a90-011ac7ecbe9b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1673 microversion: 2.20 time: 0.250073 May 23 12:40:10.283847 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 413/816] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:40:10 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1673 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:40:11.312454 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-9bfc4846-35bf-4514-986b-e9c7080c04de tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:11.313232 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-9bfc4846-35bf-4514-986b-e9c7080c04de tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:11.324152 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9bfc4846-35bf-4514-986b-e9c7080c04de tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:11.324966 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9bfc4846-35bf-4514-986b-e9c7080c04de tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:11.327245 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9bfc4846-35bf-4514-986b-e9c7080c04de tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:11.333853 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9bfc4846-35bf-4514-986b-e9c7080c04de tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:11.527114 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9bfc4846-35bf-4514-986b-e9c7080c04de tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:11.540311 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9bfc4846-35bf-4514-986b-e9c7080c04de tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:11.543319 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9bfc4846-35bf-4514-986b-e9c7080c04de tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:11.545202 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-9bfc4846-35bf-4514-986b-e9c7080c04de tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1673 microversion: 2.20 time: 0.238428 May 23 12:40:11.546118 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 404/817] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:40:11 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1673 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:40:12.565670 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-482845b4-292d-4dcb-9264-907d7605afbd tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:12.566828 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-482845b4-292d-4dcb-9264-907d7605afbd tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:12.569743 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=1 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:40:12.579243 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-482845b4-292d-4dcb-9264-907d7605afbd tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:12.579698 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-482845b4-292d-4dcb-9264-907d7605afbd tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:12.580524 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-482845b4-292d-4dcb-9264-907d7605afbd tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:12.581142 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-482845b4-292d-4dcb-9264-907d7605afbd tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:12.857455 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-482845b4-292d-4dcb-9264-907d7605afbd tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:12.867632 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-482845b4-292d-4dcb-9264-907d7605afbd tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:12.871476 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-482845b4-292d-4dcb-9264-907d7605afbd tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:12.876094 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-482845b4-292d-4dcb-9264-907d7605afbd tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1731 microversion: 2.20 time: 0.314139 May 23 12:40:12.881541 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 414/818] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:40:12 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1731 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:40:13.929071 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d29613ab-bf52-48ba-a130-719f570023c0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:13.930175 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d29613ab-bf52-48ba-a130-719f570023c0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:13.962072 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d29613ab-bf52-48ba-a130-719f570023c0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:13.969245 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d29613ab-bf52-48ba-a130-719f570023c0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:13.970427 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d29613ab-bf52-48ba-a130-719f570023c0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:13.970880 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d29613ab-bf52-48ba-a130-719f570023c0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:14.554364 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d29613ab-bf52-48ba-a130-719f570023c0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:14.565384 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d29613ab-bf52-48ba-a130-719f570023c0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:14.568382 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d29613ab-bf52-48ba-a130-719f570023c0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:14.582769 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d29613ab-bf52-48ba-a130-719f570023c0 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1731 microversion: 2.20 time: 0.674101 May 23 12:40:14.583371 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 405/819] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:40:13 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1731 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:40:15.621195 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-24916659-ba3a-464f-8560-0c99370a0fc3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:15.623683 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-24916659-ba3a-464f-8560-0c99370a0fc3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:15.638301 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-24916659-ba3a-464f-8560-0c99370a0fc3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:15.639435 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-24916659-ba3a-464f-8560-0c99370a0fc3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:15.641276 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-24916659-ba3a-464f-8560-0c99370a0fc3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:15.642371 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-24916659-ba3a-464f-8560-0c99370a0fc3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:15.917045 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-24916659-ba3a-464f-8560-0c99370a0fc3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:15.930176 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-24916659-ba3a-464f-8560-0c99370a0fc3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:15.933143 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-24916659-ba3a-464f-8560-0c99370a0fc3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:15.934952 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-24916659-ba3a-464f-8560-0c99370a0fc3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1731 microversion: 2.20 time: 0.328935 May 23 12:40:15.936043 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 415/820] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:40:15 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1731 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:40:16.964808 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-a91b9102-f2cb-49d4-89e9-f33c04d72ed1 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:16.966322 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-a91b9102-f2cb-49d4-89e9-f33c04d72ed1 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:16.978984 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a91b9102-f2cb-49d4-89e9-f33c04d72ed1 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:16.981703 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a91b9102-f2cb-49d4-89e9-f33c04d72ed1 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:16.983305 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a91b9102-f2cb-49d4-89e9-f33c04d72ed1 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:16.984021 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a91b9102-f2cb-49d4-89e9-f33c04d72ed1 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:17.328139 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-a91b9102-f2cb-49d4-89e9-f33c04d72ed1 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:17.369988 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-a91b9102-f2cb-49d4-89e9-f33c04d72ed1 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:17.371988 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-a91b9102-f2cb-49d4-89e9-f33c04d72ed1 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:17.374078 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-a91b9102-f2cb-49d4-89e9-f33c04d72ed1 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1731 microversion: 2.20 time: 0.414461 May 23 12:40:17.375714 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 406/821] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:40:16 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1731 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:40:18.401703 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-9dd0cfe0-9265-48a1-9321-06b65ad9b7d5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:18.404119 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-9dd0cfe0-9265-48a1-9321-06b65ad9b7d5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:18.418345 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9dd0cfe0-9265-48a1-9321-06b65ad9b7d5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:18.419214 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9dd0cfe0-9265-48a1-9321-06b65ad9b7d5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:18.420665 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9dd0cfe0-9265-48a1-9321-06b65ad9b7d5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:18.421554 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9dd0cfe0-9265-48a1-9321-06b65ad9b7d5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:18.687228 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-9dd0cfe0-9265-48a1-9321-06b65ad9b7d5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:18.702132 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-9dd0cfe0-9265-48a1-9321-06b65ad9b7d5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:18.705099 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-9dd0cfe0-9265-48a1-9321-06b65ad9b7d5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:18.707605 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-9dd0cfe0-9265-48a1-9321-06b65ad9b7d5 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1731 microversion: 2.20 time: 0.315187 May 23 12:40:18.720186 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 416/822] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:40:18 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1731 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:40:19.746803 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-723885d1-1dba-4b02-8cf1-7c4d7fc865ee tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:19.747862 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-723885d1-1dba-4b02-8cf1-7c4d7fc865ee tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:19.779500 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-723885d1-1dba-4b02-8cf1-7c4d7fc865ee tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:19.780530 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-723885d1-1dba-4b02-8cf1-7c4d7fc865ee tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:19.781878 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-723885d1-1dba-4b02-8cf1-7c4d7fc865ee tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:19.782632 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-723885d1-1dba-4b02-8cf1-7c4d7fc865ee tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:20.213782 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-723885d1-1dba-4b02-8cf1-7c4d7fc865ee tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:20.258235 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-723885d1-1dba-4b02-8cf1-7c4d7fc865ee tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:20.261669 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-723885d1-1dba-4b02-8cf1-7c4d7fc865ee tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:20.267066 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-723885d1-1dba-4b02-8cf1-7c4d7fc865ee tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1731 microversion: 2.20 time: 0.528650 May 23 12:40:20.268155 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 407/823] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:40:19 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1731 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:40:21.301106 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-4fae8510-3705-4c08-b020-184d580b6723 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:21.302095 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-4fae8510-3705-4c08-b020-184d580b6723 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:21.317079 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4fae8510-3705-4c08-b020-184d580b6723 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:21.319417 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4fae8510-3705-4c08-b020-184d580b6723 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:21.324293 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4fae8510-3705-4c08-b020-184d580b6723 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:21.327728 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4fae8510-3705-4c08-b020-184d580b6723 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:21.632295 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-4fae8510-3705-4c08-b020-184d580b6723 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:21.638732 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-4fae8510-3705-4c08-b020-184d580b6723 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:21.640911 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-4fae8510-3705-4c08-b020-184d580b6723 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:21.642427 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-4fae8510-3705-4c08-b020-184d580b6723 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1731 microversion: 2.20 time: 0.346564 May 23 12:40:21.643440 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 417/824] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:40:21 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1731 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:40:22.676324 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-cce1e134-c388-45d4-8a39-2e973b7d575a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:22.679269 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-cce1e134-c388-45d4-8a39-2e973b7d575a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:22.705454 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cce1e134-c388-45d4-8a39-2e973b7d575a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:22.711887 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cce1e134-c388-45d4-8a39-2e973b7d575a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:22.714988 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cce1e134-c388-45d4-8a39-2e973b7d575a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:22.722432 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cce1e134-c388-45d4-8a39-2e973b7d575a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:23.113930 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-cce1e134-c388-45d4-8a39-2e973b7d575a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:23.134361 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-cce1e134-c388-45d4-8a39-2e973b7d575a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:23.136577 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-cce1e134-c388-45d4-8a39-2e973b7d575a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:23.137828 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-cce1e134-c388-45d4-8a39-2e973b7d575a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1731 microversion: 2.20 time: 0.470189 May 23 12:40:23.138910 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 408/825] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:40:22 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1731 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:40:24.160764 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-188e08f4-39e5-46f2-80a9-e2944fe86dde tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:24.161883 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-188e08f4-39e5-46f2-80a9-e2944fe86dde tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:24.172722 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-188e08f4-39e5-46f2-80a9-e2944fe86dde tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:24.173496 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-188e08f4-39e5-46f2-80a9-e2944fe86dde tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:24.174803 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-188e08f4-39e5-46f2-80a9-e2944fe86dde tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:24.176038 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-188e08f4-39e5-46f2-80a9-e2944fe86dde tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:24.391434 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-188e08f4-39e5-46f2-80a9-e2944fe86dde tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:24.400666 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-188e08f4-39e5-46f2-80a9-e2944fe86dde tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:24.402556 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-188e08f4-39e5-46f2-80a9-e2944fe86dde tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:24.403727 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-188e08f4-39e5-46f2-80a9-e2944fe86dde tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1731 microversion: 2.20 time: 0.250634 May 23 12:40:24.404306 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 418/826] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:40:24 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1731 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:40:25.431856 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c6304d15-d4d9-43dd-bb6d-9e5b3299f74a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:25.432833 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c6304d15-d4d9-43dd-bb6d-9e5b3299f74a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:25.443728 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c6304d15-d4d9-43dd-bb6d-9e5b3299f74a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:25.444199 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c6304d15-d4d9-43dd-bb6d-9e5b3299f74a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:25.445373 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c6304d15-d4d9-43dd-bb6d-9e5b3299f74a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:25.445952 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c6304d15-d4d9-43dd-bb6d-9e5b3299f74a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:25.635918 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c6304d15-d4d9-43dd-bb6d-9e5b3299f74a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:25.645996 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c6304d15-d4d9-43dd-bb6d-9e5b3299f74a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:25.648623 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c6304d15-d4d9-43dd-bb6d-9e5b3299f74a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:25.649950 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c6304d15-d4d9-43dd-bb6d-9e5b3299f74a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1731 microversion: 2.20 time: 0.222764 May 23 12:40:25.650610 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 409/827] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:40:25 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1731 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:40:26.675995 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-b245b1d6-a943-4512-aef5-e4c448025c42 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:26.677559 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-b245b1d6-a943-4512-aef5-e4c448025c42 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:26.694780 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b245b1d6-a943-4512-aef5-e4c448025c42 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:26.695571 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b245b1d6-a943-4512-aef5-e4c448025c42 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:26.697195 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b245b1d6-a943-4512-aef5-e4c448025c42 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:26.698194 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b245b1d6-a943-4512-aef5-e4c448025c42 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:26.967390 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-b245b1d6-a943-4512-aef5-e4c448025c42 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:26.976635 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-b245b1d6-a943-4512-aef5-e4c448025c42 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:26.981134 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-b245b1d6-a943-4512-aef5-e4c448025c42 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:26.982357 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-b245b1d6-a943-4512-aef5-e4c448025c42 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1731 microversion: 2.20 time: 0.315337 May 23 12:40:26.982912 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 419/828] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:40:26 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1731 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:40:28.005011 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-93f44269-688d-47cb-9cb3-ba5f447ab8d9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:28.005917 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-93f44269-688d-47cb-9cb3-ba5f447ab8d9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:28.013378 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-93f44269-688d-47cb-9cb3-ba5f447ab8d9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:28.013959 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-93f44269-688d-47cb-9cb3-ba5f447ab8d9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:28.014932 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-93f44269-688d-47cb-9cb3-ba5f447ab8d9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:28.015538 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-93f44269-688d-47cb-9cb3-ba5f447ab8d9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:28.202254 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-93f44269-688d-47cb-9cb3-ba5f447ab8d9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:28.219133 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-93f44269-688d-47cb-9cb3-ba5f447ab8d9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:28.223670 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-93f44269-688d-47cb-9cb3-ba5f447ab8d9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:28.225723 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-93f44269-688d-47cb-9cb3-ba5f447ab8d9 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1731 microversion: 2.20 time: 0.227611 May 23 12:40:28.227187 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 410/829] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:40:27 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1731 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:40:28.790034 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-b8299f1d-63e1-49b4-9c80-e9c2ee741a89 req-8ee1919b-943e-4dd3-b8ed-591382f2bb07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40320b2c-6137-4266-b3b6-fb76f3d6d654", "name": "network-vif-plugged", "status": "completed", "tag": "c581b4f8-de6e-4314-a04e-aca7063e49e5"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:40:28.815623 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-b8299f1d-63e1-49b4-9c80-e9c2ee741a89 req-8ee1919b-943e-4dd3-b8ed-591382f2bb07 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:28.816540 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-b8299f1d-63e1-49b4-9c80-e9c2ee741a89 req-8ee1919b-943e-4dd3-b8ed-591382f2bb07 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:28.843626 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-b8299f1d-63e1-49b4-9c80-e9c2ee741a89 req-8ee1919b-943e-4dd3-b8ed-591382f2bb07 service nova] Creating event network-vif-plugged:c581b4f8-de6e-4314-a04e-aca7063e49e5 for instance 40320b2c-6137-4266-b3b6-fb76f3d6d654 on hv-cinder-83699 May 23 12:40:28.857066 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-b8299f1d-63e1-49b4-9c80-e9c2ee741a89 req-8ee1919b-943e-4dd3-b8ed-591382f2bb07 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077933 May 23 12:40:28.857918 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 420/830] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:40:29.248666 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-2334f68e-1473-45b9-9715-9ee0043d85c3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:29.249443 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-2334f68e-1473-45b9-9715-9ee0043d85c3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:29.258137 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2334f68e-1473-45b9-9715-9ee0043d85c3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:29.260003 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2334f68e-1473-45b9-9715-9ee0043d85c3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:29.260003 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2334f68e-1473-45b9-9715-9ee0043d85c3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:29.260296 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2334f68e-1473-45b9-9715-9ee0043d85c3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:29.595315 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-2334f68e-1473-45b9-9715-9ee0043d85c3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:29.616792 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-2334f68e-1473-45b9-9715-9ee0043d85c3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:29.619877 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-2334f68e-1473-45b9-9715-9ee0043d85c3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:29.621896 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-2334f68e-1473-45b9-9715-9ee0043d85c3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1731 microversion: 2.20 time: 0.380478 May 23 12:40:29.622943 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 411/831] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:40:29 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1731 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:40:30.643037 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-123b34cf-1197-454d-86b9-917a271efafd tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:30.644377 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-123b34cf-1197-454d-86b9-917a271efafd tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:30.650883 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-123b34cf-1197-454d-86b9-917a271efafd tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:30.651336 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-123b34cf-1197-454d-86b9-917a271efafd tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:30.652112 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-123b34cf-1197-454d-86b9-917a271efafd tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:30.652753 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-123b34cf-1197-454d-86b9-917a271efafd tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:30.806497 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-123b34cf-1197-454d-86b9-917a271efafd tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:30.814715 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-123b34cf-1197-454d-86b9-917a271efafd tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:30.817592 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-123b34cf-1197-454d-86b9-917a271efafd tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:30.818757 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-123b34cf-1197-454d-86b9-917a271efafd tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1731 microversion: 2.20 time: 0.180596 May 23 12:40:30.819308 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 421/832] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:40:30 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:40:31.837305 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-16b4bc10-5556-4201-9b07-af4f4d503749 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:31.837967 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-16b4bc10-5556-4201-9b07-af4f4d503749 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:31.844772 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-16b4bc10-5556-4201-9b07-af4f4d503749 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:31.845247 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-16b4bc10-5556-4201-9b07-af4f4d503749 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:31.846594 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-16b4bc10-5556-4201-9b07-af4f4d503749 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:31.848056 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-16b4bc10-5556-4201-9b07-af4f4d503749 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:31.855361 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:40:31.990626 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-16b4bc10-5556-4201-9b07-af4f4d503749 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:31.998729 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-16b4bc10-5556-4201-9b07-af4f4d503749 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:32.000253 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-16b4bc10-5556-4201-9b07-af4f4d503749 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:32.001429 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-16b4bc10-5556-4201-9b07-af4f4d503749 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1731 microversion: 2.20 time: 0.168144 May 23 12:40:32.001986 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 412/833] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:40:31 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:40:33.020603 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-6ad99ada-92aa-4d47-8a20-fbae4797d51a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:33.021289 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-6ad99ada-92aa-4d47-8a20-fbae4797d51a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:33.029773 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6ad99ada-92aa-4d47-8a20-fbae4797d51a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:33.030280 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6ad99ada-92aa-4d47-8a20-fbae4797d51a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:33.031073 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6ad99ada-92aa-4d47-8a20-fbae4797d51a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:33.031518 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6ad99ada-92aa-4d47-8a20-fbae4797d51a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:33.169901 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-6ad99ada-92aa-4d47-8a20-fbae4797d51a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:33.184010 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-6ad99ada-92aa-4d47-8a20-fbae4797d51a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:33.186776 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-6ad99ada-92aa-4d47-8a20-fbae4797d51a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:33.188766 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-6ad99ada-92aa-4d47-8a20-fbae4797d51a tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1731 microversion: 2.20 time: 0.172649 May 23 12:40:33.189672 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 422/834] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:40:33 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:40:33.792634 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-91b2c3fc-93e1-48a9-a984-e15348dbe2f4 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-901968818", "imageRef": "bb11dfa4-2977-4163-8237-78c871c8437f", "flavorRef": "452", "networks": [{"uuid": "9fe88df3-d20c-4ec8-8a62-67cd5e38ccd1"}]}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:40:33.844806 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.network.neutron [None req-91b2c3fc-93e1-48a9-a984-e15348dbe2f4 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] validate_networks() for [('9fe88df3-d20c-4ec8-8a62-67cd5e38ccd1', None, None, None, None, None)] {{(pid=124199) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 12:40:34.216936 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-6a96a50e-fd4b-44aa-8e89-674c66af0656 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:34.217615 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-6a96a50e-fd4b-44aa-8e89-674c66af0656 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:34.218184 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-91b2c3fc-93e1-48a9-a984-e15348dbe2f4 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Flavor limits 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 12:40:34.218607 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-91b2c3fc-93e1-48a9-a984-e15348dbe2f4 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Image limits 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 12:40:34.219088 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-91b2c3fc-93e1-48a9-a984-e15348dbe2f4 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Flavor pref 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 12:40:34.219492 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-91b2c3fc-93e1-48a9-a984-e15348dbe2f4 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Image pref 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 12:40:34.219924 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-91b2c3fc-93e1-48a9-a984-e15348dbe2f4 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 12:40:34.227241 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6a96a50e-fd4b-44aa-8e89-674c66af0656 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:34.228073 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6a96a50e-fd4b-44aa-8e89-674c66af0656 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:34.229321 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6a96a50e-fd4b-44aa-8e89-674c66af0656 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:34.230075 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6a96a50e-fd4b-44aa-8e89-674c66af0656 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:34.238010 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-91b2c3fc-93e1-48a9-a984-e15348dbe2f4 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:34.238905 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-91b2c3fc-93e1-48a9-a984-e15348dbe2f4 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:34.240473 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-91b2c3fc-93e1-48a9-a984-e15348dbe2f4 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:34.241290 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-91b2c3fc-93e1-48a9-a984-e15348dbe2f4 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:34.270986 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-91b2c3fc-93e1-48a9-a984-e15348dbe2f4 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Getting quotas for project c1f2700efc5d45119cc13a60bc0f25f0. Resources: {'instances', 'cores', 'ram'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:40:34.277395 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-91b2c3fc-93e1-48a9-a984-e15348dbe2f4 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Getting quotas for user be8b5c7b8f48419ebcae6a1913661afa and project c1f2700efc5d45119cc13a60bc0f25f0. Resources: {'instances', 'cores', 'ram'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:40:34.296511 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-91b2c3fc-93e1-48a9-a984-e15348dbe2f4 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Going to run 1 instances... {{(pid=124199) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 12:40:34.301216 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-91b2c3fc-93e1-48a9-a984-e15348dbe2f4 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] [instance: 15dfebca-aa48-4dba-b998-4fcd26591e1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb11dfa4-2977-4163-8237-78c871c8437f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124199) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 12:40:34.360248 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-91b2c3fc-93e1-48a9-a984-e15348dbe2f4 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.571568 May 23 12:40:34.361887 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 413/835] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 23 12:40:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 12:40:34.372109 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-9dcb6389-f416-4961-8e9f-da0160bdc6f0 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:34.373072 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-9dcb6389-f416-4961-8e9f-da0160bdc6f0 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] [instance: 15dfebca-aa48-4dba-b998-4fcd26591e1a] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:34.430116 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-6a96a50e-fd4b-44aa-8e89-674c66af0656 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:34.439559 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-6a96a50e-fd4b-44aa-8e89-674c66af0656 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:34.441794 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-6a96a50e-fd4b-44aa-8e89-674c66af0656 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:34.443240 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-6a96a50e-fd4b-44aa-8e89-674c66af0656 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1731 microversion: 2.20 time: 0.233592 May 23 12:40:34.444256 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 423/836] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:40:34 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1731 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:40:34.449203 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9dcb6389-f416-4961-8e9f-da0160bdc6f0 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8b5c7b8f48419ebcae6a1913661afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2700efc5d45119cc13a60bc0f25f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:34.463263 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-9dcb6389-f416-4961-8e9f-da0160bdc6f0 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] 10.222.0.16 "GET /compute/v2.1/servers/15dfebca-aa48-4dba-b998-4fcd26591e1a" status: 200 len: 1213 microversion: 2.1 time: 0.094570 May 23 12:40:34.464400 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 414/837] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:40:34 2022] GET /compute/v2.1/servers/15dfebca-aa48-4dba-b998-4fcd26591e1a => generated 1213 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:40:35.471218 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-b0ee8cdc-6132-4e83-b2c1-63471ad6497e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:35.471884 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-b0ee8cdc-6132-4e83-b2c1-63471ad6497e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:35.478635 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b0ee8cdc-6132-4e83-b2c1-63471ad6497e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:35.479194 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b0ee8cdc-6132-4e83-b2c1-63471ad6497e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:35.479808 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b0ee8cdc-6132-4e83-b2c1-63471ad6497e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:35.480270 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b0ee8cdc-6132-4e83-b2c1-63471ad6497e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:35.481429 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-906951b8-30de-4726-8ec0-90dd9e572104 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:35.482020 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-906951b8-30de-4726-8ec0-90dd9e572104 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] [instance: 15dfebca-aa48-4dba-b998-4fcd26591e1a] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:35.489532 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-906951b8-30de-4726-8ec0-90dd9e572104 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:35.489973 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-906951b8-30de-4726-8ec0-90dd9e572104 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:35.490763 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-906951b8-30de-4726-8ec0-90dd9e572104 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:35.491206 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-906951b8-30de-4726-8ec0-90dd9e572104 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:35.570062 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-906951b8-30de-4726-8ec0-90dd9e572104 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8b5c7b8f48419ebcae6a1913661afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2700efc5d45119cc13a60bc0f25f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:35.577641 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-906951b8-30de-4726-8ec0-90dd9e572104 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] 10.222.0.16 "GET /compute/v2.1/servers/15dfebca-aa48-4dba-b998-4fcd26591e1a" status: 200 len: 1217 microversion: 2.1 time: 0.100485 May 23 12:40:35.578232 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 415/838] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:40:35 2022] GET /compute/v2.1/servers/15dfebca-aa48-4dba-b998-4fcd26591e1a => generated 1217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:40:35.639116 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-b0ee8cdc-6132-4e83-b2c1-63471ad6497e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:35.647771 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-b0ee8cdc-6132-4e83-b2c1-63471ad6497e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:35.649316 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-b0ee8cdc-6132-4e83-b2c1-63471ad6497e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:35.650466 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-b0ee8cdc-6132-4e83-b2c1-63471ad6497e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1731 microversion: 2.20 time: 0.183171 May 23 12:40:35.651020 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 424/839] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:40:35 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1731 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:40:36.598164 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-7f30a537-6156-43b9-af9e-2e4d7a432366 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:36.598802 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-7f30a537-6156-43b9-af9e-2e4d7a432366 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] [instance: 15dfebca-aa48-4dba-b998-4fcd26591e1a] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:36.606269 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7f30a537-6156-43b9-af9e-2e4d7a432366 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:36.606978 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7f30a537-6156-43b9-af9e-2e4d7a432366 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:36.608152 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7f30a537-6156-43b9-af9e-2e4d7a432366 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:36.608758 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7f30a537-6156-43b9-af9e-2e4d7a432366 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:36.669637 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-1146c69e-894b-4931-94a8-efeab59d25b6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:36.670306 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-1146c69e-894b-4931-94a8-efeab59d25b6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:36.680509 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1146c69e-894b-4931-94a8-efeab59d25b6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:36.680971 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1146c69e-894b-4931-94a8-efeab59d25b6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:36.681994 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1146c69e-894b-4931-94a8-efeab59d25b6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:36.682786 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1146c69e-894b-4931-94a8-efeab59d25b6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:36.700615 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-7f30a537-6156-43b9-af9e-2e4d7a432366 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8b5c7b8f48419ebcae6a1913661afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2700efc5d45119cc13a60bc0f25f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:36.714534 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-7f30a537-6156-43b9-af9e-2e4d7a432366 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] 10.222.0.16 "GET /compute/v2.1/servers/15dfebca-aa48-4dba-b998-4fcd26591e1a" status: 200 len: 1209 microversion: 2.1 time: 0.120050 May 23 12:40:36.720258 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 416/840] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:40:36 2022] GET /compute/v2.1/servers/15dfebca-aa48-4dba-b998-4fcd26591e1a => generated 1209 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:40:36.850503 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-1146c69e-894b-4931-94a8-efeab59d25b6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:36.859782 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-1146c69e-894b-4931-94a8-efeab59d25b6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:36.861328 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-1146c69e-894b-4931-94a8-efeab59d25b6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:36.862771 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-1146c69e-894b-4931-94a8-efeab59d25b6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1731 microversion: 2.20 time: 0.197006 May 23 12:40:36.863631 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 425/841] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:40:36 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1731 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:40:37.733916 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-3036f3dd-ec2b-45c0-81fb-727a70a68fad tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:37.734445 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-3036f3dd-ec2b-45c0-81fb-727a70a68fad tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] [instance: 15dfebca-aa48-4dba-b998-4fcd26591e1a] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:37.736728 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:40:37.742894 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3036f3dd-ec2b-45c0-81fb-727a70a68fad tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:37.743351 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3036f3dd-ec2b-45c0-81fb-727a70a68fad tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:37.744127 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3036f3dd-ec2b-45c0-81fb-727a70a68fad tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:37.744615 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3036f3dd-ec2b-45c0-81fb-727a70a68fad tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:37.812337 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-3036f3dd-ec2b-45c0-81fb-727a70a68fad tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8b5c7b8f48419ebcae6a1913661afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2700efc5d45119cc13a60bc0f25f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:37.820539 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-3036f3dd-ec2b-45c0-81fb-727a70a68fad tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] 10.222.0.16 "GET /compute/v2.1/servers/15dfebca-aa48-4dba-b998-4fcd26591e1a" status: 200 len: 1209 microversion: 2.1 time: 0.090583 May 23 12:40:37.821105 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 417/842] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:40:37 2022] GET /compute/v2.1/servers/15dfebca-aa48-4dba-b998-4fcd26591e1a => generated 1209 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:40:37.885313 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-20ffc8fd-4be2-4184-ae6f-9a910ce95fd6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:37.885931 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-20ffc8fd-4be2-4184-ae6f-9a910ce95fd6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:37.892568 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-20ffc8fd-4be2-4184-ae6f-9a910ce95fd6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:37.893024 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-20ffc8fd-4be2-4184-ae6f-9a910ce95fd6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:37.894600 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-20ffc8fd-4be2-4184-ae6f-9a910ce95fd6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:37.895059 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-20ffc8fd-4be2-4184-ae6f-9a910ce95fd6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:38.033639 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-20ffc8fd-4be2-4184-ae6f-9a910ce95fd6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:38.042631 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-20ffc8fd-4be2-4184-ae6f-9a910ce95fd6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:38.044133 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-20ffc8fd-4be2-4184-ae6f-9a910ce95fd6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:38.045332 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-20ffc8fd-4be2-4184-ae6f-9a910ce95fd6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1731 microversion: 2.20 time: 0.163999 May 23 12:40:38.045901 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 426/843] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:40:37 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:40:38.838069 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-4d58b4ee-ae08-4968-85cf-d32fbca312d9 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:38.838708 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-4d58b4ee-ae08-4968-85cf-d32fbca312d9 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] [instance: 15dfebca-aa48-4dba-b998-4fcd26591e1a] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:38.845234 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4d58b4ee-ae08-4968-85cf-d32fbca312d9 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:38.845680 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4d58b4ee-ae08-4968-85cf-d32fbca312d9 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:38.846474 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4d58b4ee-ae08-4968-85cf-d32fbca312d9 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:38.847231 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4d58b4ee-ae08-4968-85cf-d32fbca312d9 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:38.908568 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-4d58b4ee-ae08-4968-85cf-d32fbca312d9 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8b5c7b8f48419ebcae6a1913661afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2700efc5d45119cc13a60bc0f25f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:38.916336 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-4d58b4ee-ae08-4968-85cf-d32fbca312d9 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] 10.222.0.16 "GET /compute/v2.1/servers/15dfebca-aa48-4dba-b998-4fcd26591e1a" status: 200 len: 1209 microversion: 2.1 time: 0.082034 May 23 12:40:38.916892 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 418/844] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:40:38 2022] GET /compute/v2.1/servers/15dfebca-aa48-4dba-b998-4fcd26591e1a => generated 1209 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:40:39.063143 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-945c3cf0-a7f7-42fd-83e8-d39aa8cd3272 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:39.063739 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-945c3cf0-a7f7-42fd-83e8-d39aa8cd3272 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:39.071017 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-945c3cf0-a7f7-42fd-83e8-d39aa8cd3272 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:39.071461 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-945c3cf0-a7f7-42fd-83e8-d39aa8cd3272 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:39.072259 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-945c3cf0-a7f7-42fd-83e8-d39aa8cd3272 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:39.072695 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-945c3cf0-a7f7-42fd-83e8-d39aa8cd3272 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:39.206420 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-945c3cf0-a7f7-42fd-83e8-d39aa8cd3272 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:39.215151 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-945c3cf0-a7f7-42fd-83e8-d39aa8cd3272 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:39.216815 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-945c3cf0-a7f7-42fd-83e8-d39aa8cd3272 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:39.218044 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-945c3cf0-a7f7-42fd-83e8-d39aa8cd3272 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1731 microversion: 2.20 time: 0.158829 May 23 12:40:39.218720 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 427/845] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:40:39 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:40:39.933131 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-3657ce52-74c1-45ce-b5c8-92d49fc52bfc tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:39.933780 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-3657ce52-74c1-45ce-b5c8-92d49fc52bfc tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] [instance: 15dfebca-aa48-4dba-b998-4fcd26591e1a] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:39.940386 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3657ce52-74c1-45ce-b5c8-92d49fc52bfc tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:39.940856 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3657ce52-74c1-45ce-b5c8-92d49fc52bfc tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:39.941625 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3657ce52-74c1-45ce-b5c8-92d49fc52bfc tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:39.942053 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3657ce52-74c1-45ce-b5c8-92d49fc52bfc tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:40.009812 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-3657ce52-74c1-45ce-b5c8-92d49fc52bfc tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8b5c7b8f48419ebcae6a1913661afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2700efc5d45119cc13a60bc0f25f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:40.020668 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-3657ce52-74c1-45ce-b5c8-92d49fc52bfc tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] 10.222.0.16 "GET /compute/v2.1/servers/15dfebca-aa48-4dba-b998-4fcd26591e1a" status: 200 len: 1265 microversion: 2.1 time: 0.091141 May 23 12:40:40.021387 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 419/846] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:40:39 2022] GET /compute/v2.1/servers/15dfebca-aa48-4dba-b998-4fcd26591e1a => generated 1265 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:40:40.240652 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-fa111fab-5514-4a5c-84d9-1867d3f75fe3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:40.241844 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-fa111fab-5514-4a5c-84d9-1867d3f75fe3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:40.250319 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-fa111fab-5514-4a5c-84d9-1867d3f75fe3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:40.250967 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-fa111fab-5514-4a5c-84d9-1867d3f75fe3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:40.252919 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-fa111fab-5514-4a5c-84d9-1867d3f75fe3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:40.253658 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-fa111fab-5514-4a5c-84d9-1867d3f75fe3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:40.261863 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:40:40.576811 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-fa111fab-5514-4a5c-84d9-1867d3f75fe3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:40.592585 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-fa111fab-5514-4a5c-84d9-1867d3f75fe3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:40.596125 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-fa111fab-5514-4a5c-84d9-1867d3f75fe3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:40.598920 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-fa111fab-5514-4a5c-84d9-1867d3f75fe3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1718 microversion: 2.20 time: 0.364616 May 23 12:40:40.600920 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 428/847] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:40:40 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1718 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:40:41.042976 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-1c14356d-7637-48b9-9517-beacea334410 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:41.043762 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-1c14356d-7637-48b9-9517-beacea334410 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] [instance: 15dfebca-aa48-4dba-b998-4fcd26591e1a] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:41.050238 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1c14356d-7637-48b9-9517-beacea334410 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:41.050697 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1c14356d-7637-48b9-9517-beacea334410 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:41.051493 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1c14356d-7637-48b9-9517-beacea334410 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:41.051931 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1c14356d-7637-48b9-9517-beacea334410 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:41.287272 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1c14356d-7637-48b9-9517-beacea334410 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8b5c7b8f48419ebcae6a1913661afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2700efc5d45119cc13a60bc0f25f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:41.295280 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-1c14356d-7637-48b9-9517-beacea334410 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] 10.222.0.16 "GET /compute/v2.1/servers/15dfebca-aa48-4dba-b998-4fcd26591e1a" status: 200 len: 1313 microversion: 2.1 time: 0.256129 May 23 12:40:41.295877 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 420/848] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:40:41 2022] GET /compute/v2.1/servers/15dfebca-aa48-4dba-b998-4fcd26591e1a => generated 1313 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:40:41.733944 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-0a22abb4-b6ae-43aa-b39b-b3b1d604542b req-134839b5-0cba-4d99-bff2-9266ec068a02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15dfebca-aa48-4dba-b998-4fcd26591e1a", "tag": "10f412d2-2adb-42c4-89c6-b848461f35af"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:40:41.745592 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-0a22abb4-b6ae-43aa-b39b-b3b1d604542b req-134839b5-0cba-4d99-bff2-9266ec068a02 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:41.746262 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-0a22abb4-b6ae-43aa-b39b-b3b1d604542b req-134839b5-0cba-4d99-bff2-9266ec068a02 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:41.759068 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-0a22abb4-b6ae-43aa-b39b-b3b1d604542b req-134839b5-0cba-4d99-bff2-9266ec068a02 service nova] Creating event network-changed:10f412d2-2adb-42c4-89c6-b848461f35af for instance 15dfebca-aa48-4dba-b998-4fcd26591e1a on hv-cinder-83699 May 23 12:40:41.764229 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-0a22abb4-b6ae-43aa-b39b-b3b1d604542b req-134839b5-0cba-4d99-bff2-9266ec068a02 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036776 May 23 12:40:41.765065 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 429/849] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:40:42.315393 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-e45ce52a-1d97-4085-9421-d245381103b8 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:42.316352 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-e45ce52a-1d97-4085-9421-d245381103b8 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] [instance: 15dfebca-aa48-4dba-b998-4fcd26591e1a] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:42.325451 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e45ce52a-1d97-4085-9421-d245381103b8 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:42.326185 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e45ce52a-1d97-4085-9421-d245381103b8 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:42.327650 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e45ce52a-1d97-4085-9421-d245381103b8 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:42.328434 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e45ce52a-1d97-4085-9421-d245381103b8 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:42.480683 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-e45ce52a-1d97-4085-9421-d245381103b8 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8b5c7b8f48419ebcae6a1913661afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2700efc5d45119cc13a60bc0f25f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:42.489668 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-e45ce52a-1d97-4085-9421-d245381103b8 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] 10.222.0.16 "GET /compute/v2.1/servers/15dfebca-aa48-4dba-b998-4fcd26591e1a" status: 200 len: 1313 microversion: 2.1 time: 0.179900 May 23 12:40:42.490261 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 421/850] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:40:42 2022] GET /compute/v2.1/servers/15dfebca-aa48-4dba-b998-4fcd26591e1a => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:40:43.508363 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-82762567-193e-4dd9-a0df-317404cc7702 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:43.509103 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-82762567-193e-4dd9-a0df-317404cc7702 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] [instance: 15dfebca-aa48-4dba-b998-4fcd26591e1a] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:43.511089 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_api:SELECT=32 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:40:43.517177 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-82762567-193e-4dd9-a0df-317404cc7702 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:43.517710 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-82762567-193e-4dd9-a0df-317404cc7702 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:43.519201 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-82762567-193e-4dd9-a0df-317404cc7702 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:43.519679 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-82762567-193e-4dd9-a0df-317404cc7702 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:43.654166 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-82762567-193e-4dd9-a0df-317404cc7702 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8b5c7b8f48419ebcae6a1913661afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2700efc5d45119cc13a60bc0f25f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:43.662801 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-82762567-193e-4dd9-a0df-317404cc7702 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] 10.222.0.16 "GET /compute/v2.1/servers/15dfebca-aa48-4dba-b998-4fcd26591e1a" status: 200 len: 1313 microversion: 2.1 time: 0.159905 May 23 12:40:43.663363 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 430/851] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:40:43 2022] GET /compute/v2.1/servers/15dfebca-aa48-4dba-b998-4fcd26591e1a => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:40:44.682997 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-35fd3a04-a713-4d36-ad75-363ba9b721a6 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:44.683640 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-35fd3a04-a713-4d36-ad75-363ba9b721a6 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] [instance: 15dfebca-aa48-4dba-b998-4fcd26591e1a] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:44.686995 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell0:SELECT=2 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:40:44.687809 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell0:SELECT=8 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:40:44.696436 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-35fd3a04-a713-4d36-ad75-363ba9b721a6 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:44.697139 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-35fd3a04-a713-4d36-ad75-363ba9b721a6 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:44.698188 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-35fd3a04-a713-4d36-ad75-363ba9b721a6 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:44.698935 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-35fd3a04-a713-4d36-ad75-363ba9b721a6 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:44.853524 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-35fd3a04-a713-4d36-ad75-363ba9b721a6 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8b5c7b8f48419ebcae6a1913661afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2700efc5d45119cc13a60bc0f25f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:44.863314 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-35fd3a04-a713-4d36-ad75-363ba9b721a6 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] 10.222.0.16 "GET /compute/v2.1/servers/15dfebca-aa48-4dba-b998-4fcd26591e1a" status: 200 len: 1313 microversion: 2.1 time: 0.185281 May 23 12:40:44.863951 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 422/852] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:40:44 2022] GET /compute/v2.1/servers/15dfebca-aa48-4dba-b998-4fcd26591e1a => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:40:45.882128 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-d16cb007-4ae9-44db-97a4-88b954d94b23 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:45.882823 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-d16cb007-4ae9-44db-97a4-88b954d94b23 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] [instance: 15dfebca-aa48-4dba-b998-4fcd26591e1a] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:45.889417 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d16cb007-4ae9-44db-97a4-88b954d94b23 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:45.889859 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d16cb007-4ae9-44db-97a4-88b954d94b23 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:45.890624 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d16cb007-4ae9-44db-97a4-88b954d94b23 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:45.891056 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d16cb007-4ae9-44db-97a4-88b954d94b23 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:46.030861 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-d16cb007-4ae9-44db-97a4-88b954d94b23 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8b5c7b8f48419ebcae6a1913661afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2700efc5d45119cc13a60bc0f25f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:46.038804 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-d16cb007-4ae9-44db-97a4-88b954d94b23 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] 10.222.0.16 "GET /compute/v2.1/servers/15dfebca-aa48-4dba-b998-4fcd26591e1a" status: 200 len: 1313 microversion: 2.1 time: 0.161244 May 23 12:40:46.039364 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 431/853] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:40:45 2022] GET /compute/v2.1/servers/15dfebca-aa48-4dba-b998-4fcd26591e1a => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:40:47.056476 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-90dbbbc4-c11d-4a59-b30d-5ada17e46b6d tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:47.057265 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-90dbbbc4-c11d-4a59-b30d-5ada17e46b6d tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] [instance: 15dfebca-aa48-4dba-b998-4fcd26591e1a] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:47.064064 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-90dbbbc4-c11d-4a59-b30d-5ada17e46b6d tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:47.064544 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-90dbbbc4-c11d-4a59-b30d-5ada17e46b6d tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:47.066134 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-90dbbbc4-c11d-4a59-b30d-5ada17e46b6d tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:47.066425 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-90dbbbc4-c11d-4a59-b30d-5ada17e46b6d tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:47.203697 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-90dbbbc4-c11d-4a59-b30d-5ada17e46b6d tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8b5c7b8f48419ebcae6a1913661afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2700efc5d45119cc13a60bc0f25f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:47.212578 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-90dbbbc4-c11d-4a59-b30d-5ada17e46b6d tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] 10.222.0.16 "GET /compute/v2.1/servers/15dfebca-aa48-4dba-b998-4fcd26591e1a" status: 200 len: 1313 microversion: 2.1 time: 0.160474 May 23 12:40:47.213176 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 423/854] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:40:47 2022] GET /compute/v2.1/servers/15dfebca-aa48-4dba-b998-4fcd26591e1a => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:40:48.237723 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-166a2f2d-06ba-4ad0-ad36-588433db76e8 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:48.238413 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-166a2f2d-06ba-4ad0-ad36-588433db76e8 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] [instance: 15dfebca-aa48-4dba-b998-4fcd26591e1a] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:48.245540 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-166a2f2d-06ba-4ad0-ad36-588433db76e8 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:48.245986 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-166a2f2d-06ba-4ad0-ad36-588433db76e8 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:48.246754 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-166a2f2d-06ba-4ad0-ad36-588433db76e8 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:48.247184 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-166a2f2d-06ba-4ad0-ad36-588433db76e8 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:48.378606 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-166a2f2d-06ba-4ad0-ad36-588433db76e8 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8b5c7b8f48419ebcae6a1913661afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2700efc5d45119cc13a60bc0f25f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:48.386096 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-166a2f2d-06ba-4ad0-ad36-588433db76e8 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] 10.222.0.16 "GET /compute/v2.1/servers/15dfebca-aa48-4dba-b998-4fcd26591e1a" status: 200 len: 1313 microversion: 2.1 time: 0.153551 May 23 12:40:48.386659 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 432/855] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:40:48 2022] GET /compute/v2.1/servers/15dfebca-aa48-4dba-b998-4fcd26591e1a => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:40:48.959336 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-b5faa7b3-0615-4def-ac9b-919ad90cfef0 req-773c97a0-5a64-4290-a4bc-d1718519d5e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15dfebca-aa48-4dba-b998-4fcd26591e1a", "name": "network-vif-plugged", "status": "completed", "tag": "10f412d2-2adb-42c4-89c6-b848461f35af"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:40:48.967937 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-b5faa7b3-0615-4def-ac9b-919ad90cfef0 req-773c97a0-5a64-4290-a4bc-d1718519d5e6 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:48.968420 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-b5faa7b3-0615-4def-ac9b-919ad90cfef0 req-773c97a0-5a64-4290-a4bc-d1718519d5e6 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:48.982569 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-b5faa7b3-0615-4def-ac9b-919ad90cfef0 req-773c97a0-5a64-4290-a4bc-d1718519d5e6 service nova] Creating event network-vif-plugged:10f412d2-2adb-42c4-89c6-b848461f35af for instance 15dfebca-aa48-4dba-b998-4fcd26591e1a on hv-cinder-83699 May 23 12:40:48.987629 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-b5faa7b3-0615-4def-ac9b-919ad90cfef0 req-773c97a0-5a64-4290-a4bc-d1718519d5e6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032128 May 23 12:40:48.988607 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 424/856] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:40:49.402868 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-90dace93-ce49-40c4-92d2-bff619e84eb3 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:49.403528 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-90dace93-ce49-40c4-92d2-bff619e84eb3 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] [instance: 15dfebca-aa48-4dba-b998-4fcd26591e1a] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:49.410134 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-90dace93-ce49-40c4-92d2-bff619e84eb3 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:49.411094 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-90dace93-ce49-40c4-92d2-bff619e84eb3 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:49.411873 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-90dace93-ce49-40c4-92d2-bff619e84eb3 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:49.412338 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-90dace93-ce49-40c4-92d2-bff619e84eb3 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:49.542281 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-90dace93-ce49-40c4-92d2-bff619e84eb3 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8b5c7b8f48419ebcae6a1913661afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2700efc5d45119cc13a60bc0f25f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:49.549683 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-90dace93-ce49-40c4-92d2-bff619e84eb3 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] 10.222.0.16 "GET /compute/v2.1/servers/15dfebca-aa48-4dba-b998-4fcd26591e1a" status: 200 len: 1313 microversion: 2.1 time: 0.150724 May 23 12:40:49.550244 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 433/857] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:40:49 2022] GET /compute/v2.1/servers/15dfebca-aa48-4dba-b998-4fcd26591e1a => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:40:50.568340 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b6a16eca-798f-42ee-a06f-bc54a64bbdd1 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:50.569129 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-b6a16eca-798f-42ee-a06f-bc54a64bbdd1 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] [instance: 15dfebca-aa48-4dba-b998-4fcd26591e1a] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:50.575286 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b6a16eca-798f-42ee-a06f-bc54a64bbdd1 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:50.575736 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b6a16eca-798f-42ee-a06f-bc54a64bbdd1 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:50.576533 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b6a16eca-798f-42ee-a06f-bc54a64bbdd1 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:50.576969 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b6a16eca-798f-42ee-a06f-bc54a64bbdd1 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:50.754074 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b6a16eca-798f-42ee-a06f-bc54a64bbdd1 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8b5c7b8f48419ebcae6a1913661afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2700efc5d45119cc13a60bc0f25f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:50.762021 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b6a16eca-798f-42ee-a06f-bc54a64bbdd1 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] 10.222.0.16 "GET /compute/v2.1/servers/15dfebca-aa48-4dba-b998-4fcd26591e1a" status: 200 len: 1313 microversion: 2.1 time: 0.199014 May 23 12:40:50.763151 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 425/858] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:40:50 2022] GET /compute/v2.1/servers/15dfebca-aa48-4dba-b998-4fcd26591e1a => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:40:51.779251 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-d0f631cd-4c21-4943-8dfb-a4c5bb07608e tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:51.779898 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-d0f631cd-4c21-4943-8dfb-a4c5bb07608e tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] [instance: 15dfebca-aa48-4dba-b998-4fcd26591e1a] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:51.786755 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d0f631cd-4c21-4943-8dfb-a4c5bb07608e tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:51.787203 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d0f631cd-4c21-4943-8dfb-a4c5bb07608e tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:51.787978 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d0f631cd-4c21-4943-8dfb-a4c5bb07608e tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:51.788446 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d0f631cd-4c21-4943-8dfb-a4c5bb07608e tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:51.925193 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-d0f631cd-4c21-4943-8dfb-a4c5bb07608e tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8b5c7b8f48419ebcae6a1913661afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2700efc5d45119cc13a60bc0f25f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:51.932677 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-d0f631cd-4c21-4943-8dfb-a4c5bb07608e tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] 10.222.0.16 "GET /compute/v2.1/servers/15dfebca-aa48-4dba-b998-4fcd26591e1a" status: 200 len: 1496 microversion: 2.1 time: 0.157452 May 23 12:40:51.933241 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 434/859] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:40:51 2022] GET /compute/v2.1/servers/15dfebca-aa48-4dba-b998-4fcd26591e1a => generated 1496 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:40:52.336806 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b68e0864-de6a-4ab7-bf03-76cbbd564466 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:52.337369 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-b68e0864-de6a-4ab7-bf03-76cbbd564466 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] [instance: 15dfebca-aa48-4dba-b998-4fcd26591e1a] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:52.344040 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b68e0864-de6a-4ab7-bf03-76cbbd564466 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:52.344527 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b68e0864-de6a-4ab7-bf03-76cbbd564466 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:52.345307 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b68e0864-de6a-4ab7-bf03-76cbbd564466 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:52.345739 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b68e0864-de6a-4ab7-bf03-76cbbd564466 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:52.374828 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-b68e0864-de6a-4ab7-bf03-76cbbd564466 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] [instance: 15dfebca-aa48-4dba-b998-4fcd26591e1a] Going to try to terminate instance {{(pid=124199) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 12:40:52.450139 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b68e0864-de6a-4ab7-bf03-76cbbd564466 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] 10.222.0.16 "DELETE /compute/v2.1/servers/15dfebca-aa48-4dba-b998-4fcd26591e1a" status: 204 len: 0 microversion: 2.1 time: 0.117062 May 23 12:40:52.450770 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 426/860] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 12:40:52 2022] DELETE /compute/v2.1/servers/15dfebca-aa48-4dba-b998-4fcd26591e1a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 12:40:52.459470 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-b4267a4a-56f1-46bd-aad7-ac4e8ed444db tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:52.460080 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-b4267a4a-56f1-46bd-aad7-ac4e8ed444db tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] [instance: 15dfebca-aa48-4dba-b998-4fcd26591e1a] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:52.466112 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b4267a4a-56f1-46bd-aad7-ac4e8ed444db tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:52.466553 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b4267a4a-56f1-46bd-aad7-ac4e8ed444db tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:52.467312 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b4267a4a-56f1-46bd-aad7-ac4e8ed444db tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:52.467743 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b4267a4a-56f1-46bd-aad7-ac4e8ed444db tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:52.599058 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-b4267a4a-56f1-46bd-aad7-ac4e8ed444db tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8b5c7b8f48419ebcae6a1913661afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2700efc5d45119cc13a60bc0f25f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:52.606685 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-b4267a4a-56f1-46bd-aad7-ac4e8ed444db tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] 10.222.0.16 "GET /compute/v2.1/servers/15dfebca-aa48-4dba-b998-4fcd26591e1a" status: 200 len: 1502 microversion: 2.1 time: 0.151253 May 23 12:40:52.607251 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 435/861] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:40:52 2022] GET /compute/v2.1/servers/15dfebca-aa48-4dba-b998-4fcd26591e1a => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:40:53.624631 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c43a1681-27e6-42b5-b706-7a0090bd4bf7 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:53.625341 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c43a1681-27e6-42b5-b706-7a0090bd4bf7 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] [instance: 15dfebca-aa48-4dba-b998-4fcd26591e1a] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:53.632641 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c43a1681-27e6-42b5-b706-7a0090bd4bf7 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:53.633096 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c43a1681-27e6-42b5-b706-7a0090bd4bf7 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:53.633874 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c43a1681-27e6-42b5-b706-7a0090bd4bf7 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:53.634316 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c43a1681-27e6-42b5-b706-7a0090bd4bf7 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:53.765641 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c43a1681-27e6-42b5-b706-7a0090bd4bf7 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8b5c7b8f48419ebcae6a1913661afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2700efc5d45119cc13a60bc0f25f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:53.774310 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c43a1681-27e6-42b5-b706-7a0090bd4bf7 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] 10.222.0.16 "GET /compute/v2.1/servers/15dfebca-aa48-4dba-b998-4fcd26591e1a" status: 200 len: 1502 microversion: 2.1 time: 0.153852 May 23 12:40:53.775524 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 427/862] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:40:53 2022] GET /compute/v2.1/servers/15dfebca-aa48-4dba-b998-4fcd26591e1a => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:40:54.622159 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-830f2577-1edd-4dbd-8a02-61df69a2e48e req-ace835c0-6c43-4ab3-8297-04f02f2ec985 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15dfebca-aa48-4dba-b998-4fcd26591e1a", "name": "network-vif-deleted", "tag": "10f412d2-2adb-42c4-89c6-b848461f35af"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:40:54.635158 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-830f2577-1edd-4dbd-8a02-61df69a2e48e req-ace835c0-6c43-4ab3-8297-04f02f2ec985 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:54.635963 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-830f2577-1edd-4dbd-8a02-61df69a2e48e req-ace835c0-6c43-4ab3-8297-04f02f2ec985 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:54.649149 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-830f2577-1edd-4dbd-8a02-61df69a2e48e req-ace835c0-6c43-4ab3-8297-04f02f2ec985 service nova] Creating event network-vif-deleted:10f412d2-2adb-42c4-89c6-b848461f35af for instance 15dfebca-aa48-4dba-b998-4fcd26591e1a on hv-cinder-83699 May 23 12:40:54.654382 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-830f2577-1edd-4dbd-8a02-61df69a2e48e req-ace835c0-6c43-4ab3-8297-04f02f2ec985 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036259 May 23 12:40:54.655196 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 436/863] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:40:54.791072 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-9ff49785-4391-48f5-9dbd-3fd7838e2aa5 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:54.791609 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-9ff49785-4391-48f5-9dbd-3fd7838e2aa5 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] [instance: 15dfebca-aa48-4dba-b998-4fcd26591e1a] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:54.798159 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9ff49785-4391-48f5-9dbd-3fd7838e2aa5 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:54.798610 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9ff49785-4391-48f5-9dbd-3fd7838e2aa5 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:54.799378 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9ff49785-4391-48f5-9dbd-3fd7838e2aa5 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:54.799820 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9ff49785-4391-48f5-9dbd-3fd7838e2aa5 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:54.830973 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9ff49785-4391-48f5-9dbd-3fd7838e2aa5 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:54.831420 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9ff49785-4391-48f5-9dbd-3fd7838e2aa5 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:54.831873 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.objects.instance [None req-9ff49785-4391-48f5-9dbd-3fd7838e2aa5 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lazy-loading 'fault' on Instance uuid 15dfebca-aa48-4dba-b998-4fcd26591e1a {{(pid=124199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:40:54.872287 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9ff49785-4391-48f5-9dbd-3fd7838e2aa5 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8b5c7b8f48419ebcae6a1913661afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2700efc5d45119cc13a60bc0f25f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:54.880440 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-9ff49785-4391-48f5-9dbd-3fd7838e2aa5 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] 10.222.0.16 "GET /compute/v2.1/servers/15dfebca-aa48-4dba-b998-4fcd26591e1a" status: 200 len: 1303 microversion: 2.1 time: 0.092529 May 23 12:40:54.880989 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 428/864] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:40:54 2022] GET /compute/v2.1/servers/15dfebca-aa48-4dba-b998-4fcd26591e1a => generated 1303 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:40:55.898716 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-df4a4d53-86d4-462d-82e1-f6cc7285ec6d tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:55.899642 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-df4a4d53-86d4-462d-82e1-f6cc7285ec6d tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] [instance: 15dfebca-aa48-4dba-b998-4fcd26591e1a] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:55.905926 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-df4a4d53-86d4-462d-82e1-f6cc7285ec6d tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:55.906366 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-df4a4d53-86d4-462d-82e1-f6cc7285ec6d tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:55.907126 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-df4a4d53-86d4-462d-82e1-f6cc7285ec6d tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:55.907556 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-df4a4d53-86d4-462d-82e1-f6cc7285ec6d tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:55.921640 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.wsgi [None req-df4a4d53-86d4-462d-82e1-f6cc7285ec6d tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] HTTP exception thrown: Instance 15dfebca-aa48-4dba-b998-4fcd26591e1a could not be found. May 23 12:40:55.923240 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-df4a4d53-86d4-462d-82e1-f6cc7285ec6d tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Request method failure captured: May 23 12:40:55.923240 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: request: GET /compute/v2.1/servers/15dfebca-aa48-4dba-b998-4fcd26591e1a HTTP/1.1 May 23 12:40:55.923240 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept: application/json May 23 12:40:55.923240 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept-Encoding: identity May 23 12:40:55.923240 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Connection: close May 23 12:40:55.923240 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Length: 0 May 23 12:40:55.923240 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Type: application/json May 23 12:40:55.923240 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Host: 10.222.0.16 May 23 12:40:55.923240 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Openstack-System-Scope: None May 23 12:40:55.923240 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: User-Agent: python-urllib3/1.26.9 May 23 12:40:55.923240 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Auth-Token: gAAAAABii4C-b8I_ghTqH_mkrxhkP3uOzib58kySR747ujzuhePrGUqGkAtSllEtSmZGNMSIww4nM-wGpn0rlU_XNCbnLMyfYyf-SxKLx4XOqgKCPO_sbtql10_UJ_yNvU5auTvmqvnIffipqffCkAZ3jiVbfyHOyebrxnXJQsDu-HxzME4w84o May 23 12:40:55.923240 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Id: None May 23 12:40:55.923240 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Name: None May 23 12:40:55.923240 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Identity-Status: Confirmed May 23 12:40:55.923240 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Is-Admin-Project: True May 23 12:40:55.923240 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Id: default May 23 12:40:55.923240 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Name: Default May 23 12:40:55.923240 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Id: c1f2700efc5d45119cc13a60bc0f25f0 May 23 12:40:55.923240 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Name: tempest-VolumesActionsTest-208212068 May 23 12:40:55.923240 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Role: member,reader May 23 12:40:55.923240 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Roles: member,reader May 23 12:40:55.924965 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c1f2700efc5d45119cc13a60bc0f25f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c1f2700efc5d45119cc13a60bc0f25f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c1f2700efc5d45119cc13a60bc0f25f0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c1f2700efc5d45119cc13a60bc0f25f0"}]}] May 23 12:40:55.924965 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant: tempest-VolumesActionsTest-208212068 May 23 12:40:55.924965 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Id: c1f2700efc5d45119cc13a60bc0f25f0 May 23 12:40:55.924965 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Name: tempest-VolumesActionsTest-208212068 May 23 12:40:55.924965 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User: tempest-VolumesActionsTest-208212068-project May 23 12:40:55.924965 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Id: default May 23 12:40:55.924965 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Name: Default May 23 12:40:55.924965 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Id: be8b5c7b8f48419ebcae6a1913661afa May 23 12:40:55.924965 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Name: tempest-VolumesActionsTest-208212068-project May 23 12:40:55.924965 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: method: > May 23 12:40:55.924965 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: exception: Instance 15dfebca-aa48-4dba-b998-4fcd26591e1a could not be found. May 23 12:40:55.924965 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: action_args: {'id': '15dfebca-aa48-4dba-b998-4fcd26591e1a'} May 23 12:40:55.926038 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:40:55.926038 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:40:55.926038 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:40:55.926038 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:40:55.926038 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:40:55.926038 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:40:55.926038 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:40:55.926038 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:40:55.926038 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:40:55.926038 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:40:55.926038 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15dfebca-aa48-4dba-b998-4fcd26591e1a could not be found. May 23 12:40:55.926038 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:40:55.926038 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:40:55.926038 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:40:55.926038 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:40:55.926038 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:40:55.926038 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:40:55.926038 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:40:55.926038 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:40:55.926038 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:40:55.927726 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:40:55.927726 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:40:55.927726 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:40:55.927726 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:40:55.927726 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:40:55.927726 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:40:55.927726 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:40:55.927726 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15dfebca-aa48-4dba-b998-4fcd26591e1a could not be found. May 23 12:40:55.927726 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:40:55.927726 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:40:55.927726 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:40:55.927726 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:40:55.927726 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:40:55.927726 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:40:55.927726 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:40:55.927726 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:40:55.927726 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15dfebca-aa48-4dba-b998-4fcd26591e1a could not be found. May 23 12:40:55.927726 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:40:55.929137 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-df4a4d53-86d4-462d-82e1-f6cc7285ec6d tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Returning 404 to user: Instance 15dfebca-aa48-4dba-b998-4fcd26591e1a could not be found. {{(pid=124200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:40:55.929137 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-df4a4d53-86d4-462d-82e1-f6cc7285ec6d tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] 10.222.0.16 "GET /compute/v2.1/servers/15dfebca-aa48-4dba-b998-4fcd26591e1a" status: 404 len: 111 microversion: 2.1 time: 0.031080 May 23 12:40:55.929137 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 437/865] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:40:55 2022] GET /compute/v2.1/servers/15dfebca-aa48-4dba-b998-4fcd26591e1a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:40:56.021387 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-fb6e2880-1518-4e8c-bc54-0ca68d9cf127 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1521928731", "imageRef": "bb11dfa4-2977-4163-8237-78c871c8437f", "flavorRef": "452", "networks": [{"uuid": "9fe88df3-d20c-4ec8-8a62-67cd5e38ccd1"}]}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:40:56.072845 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.network.neutron [None req-fb6e2880-1518-4e8c-bc54-0ca68d9cf127 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] validate_networks() for [('9fe88df3-d20c-4ec8-8a62-67cd5e38ccd1', None, None, None, None, None)] {{(pid=124199) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 12:40:56.410267 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-fb6e2880-1518-4e8c-bc54-0ca68d9cf127 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Flavor limits 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 12:40:56.410690 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-fb6e2880-1518-4e8c-bc54-0ca68d9cf127 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Image limits 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 12:40:56.411513 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-fb6e2880-1518-4e8c-bc54-0ca68d9cf127 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Flavor pref 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 12:40:56.411955 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-fb6e2880-1518-4e8c-bc54-0ca68d9cf127 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Image pref 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 12:40:56.412411 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-fb6e2880-1518-4e8c-bc54-0ca68d9cf127 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 12:40:56.421172 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fb6e2880-1518-4e8c-bc54-0ca68d9cf127 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:56.421615 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fb6e2880-1518-4e8c-bc54-0ca68d9cf127 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:56.422422 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fb6e2880-1518-4e8c-bc54-0ca68d9cf127 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:56.422919 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fb6e2880-1518-4e8c-bc54-0ca68d9cf127 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:56.430495 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:40:56.443644 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-fb6e2880-1518-4e8c-bc54-0ca68d9cf127 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Getting quotas for project c1f2700efc5d45119cc13a60bc0f25f0. Resources: {'instances', 'cores', 'ram'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:40:56.447456 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-fb6e2880-1518-4e8c-bc54-0ca68d9cf127 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Getting quotas for user be8b5c7b8f48419ebcae6a1913661afa and project c1f2700efc5d45119cc13a60bc0f25f0. Resources: {'instances', 'cores', 'ram'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:40:56.458618 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-fb6e2880-1518-4e8c-bc54-0ca68d9cf127 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Going to run 1 instances... {{(pid=124199) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 12:40:56.460871 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-fb6e2880-1518-4e8c-bc54-0ca68d9cf127 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] [instance: e425f4da-b07f-4931-965f-6edcddab8b8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb11dfa4-2977-4163-8237-78c871c8437f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124199) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 12:40:56.508704 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-fb6e2880-1518-4e8c-bc54-0ca68d9cf127 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.491882 May 23 12:40:56.509343 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 429/866] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 23 12:40:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 493 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 12:40:56.519000 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-3f652430-96a8-4586-bbd8-bbaa95019296 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:56.519607 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-3f652430-96a8-4586-bbd8-bbaa95019296 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] [instance: e425f4da-b07f-4931-965f-6edcddab8b8c] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:56.574883 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-3f652430-96a8-4586-bbd8-bbaa95019296 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8b5c7b8f48419ebcae6a1913661afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2700efc5d45119cc13a60bc0f25f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:56.581883 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-3f652430-96a8-4586-bbd8-bbaa95019296 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] 10.222.0.16 "GET /compute/v2.1/servers/e425f4da-b07f-4931-965f-6edcddab8b8c" status: 200 len: 1214 microversion: 2.1 time: 0.066642 May 23 12:40:56.582569 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 438/867] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:40:56 2022] GET /compute/v2.1/servers/e425f4da-b07f-4931-965f-6edcddab8b8c => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:40:57.601791 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-fe00455a-42b0-46a2-b45a-6c9c2c06164a tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:57.602416 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-fe00455a-42b0-46a2-b45a-6c9c2c06164a tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] [instance: e425f4da-b07f-4931-965f-6edcddab8b8c] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:57.609423 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fe00455a-42b0-46a2-b45a-6c9c2c06164a tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:57.609864 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fe00455a-42b0-46a2-b45a-6c9c2c06164a tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:57.610639 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fe00455a-42b0-46a2-b45a-6c9c2c06164a tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:57.611073 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fe00455a-42b0-46a2-b45a-6c9c2c06164a tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:57.709689 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-fe00455a-42b0-46a2-b45a-6c9c2c06164a tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8b5c7b8f48419ebcae6a1913661afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2700efc5d45119cc13a60bc0f25f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:57.717275 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-fe00455a-42b0-46a2-b45a-6c9c2c06164a tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] 10.222.0.16 "GET /compute/v2.1/servers/e425f4da-b07f-4931-965f-6edcddab8b8c" status: 200 len: 1272 microversion: 2.1 time: 0.120563 May 23 12:40:57.717879 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 430/868] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:40:57 2022] GET /compute/v2.1/servers/e425f4da-b07f-4931-965f-6edcddab8b8c => generated 1272 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:40:58.715897 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-2466b489-d8df-4fb6-9343-b75be3d72355 req-4659ea04-28e9-4091-ae26-a5fb0405c165 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e425f4da-b07f-4931-965f-6edcddab8b8c", "tag": "b044c603-8c60-4064-b5f9-6256664601bf"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:40:58.726889 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-2466b489-d8df-4fb6-9343-b75be3d72355 req-4659ea04-28e9-4091-ae26-a5fb0405c165 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:58.727495 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-2466b489-d8df-4fb6-9343-b75be3d72355 req-4659ea04-28e9-4091-ae26-a5fb0405c165 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:58.733924 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b61ad1d1-6452-442c-8361-108044f10dfa tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:58.734538 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-b61ad1d1-6452-442c-8361-108044f10dfa tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] [instance: e425f4da-b07f-4931-965f-6edcddab8b8c] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:40:58.743623 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b61ad1d1-6452-442c-8361-108044f10dfa tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:58.744083 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b61ad1d1-6452-442c-8361-108044f10dfa tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:58.744929 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b61ad1d1-6452-442c-8361-108044f10dfa tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:40:58.745375 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b61ad1d1-6452-442c-8361-108044f10dfa tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:40:58.759049 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-2466b489-d8df-4fb6-9343-b75be3d72355 req-4659ea04-28e9-4091-ae26-a5fb0405c165 service nova] Creating event network-changed:b044c603-8c60-4064-b5f9-6256664601bf for instance e425f4da-b07f-4931-965f-6edcddab8b8c on hv-cinder-83699 May 23 12:40:58.764083 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-2466b489-d8df-4fb6-9343-b75be3d72355 req-4659ea04-28e9-4091-ae26-a5fb0405c165 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051845 May 23 12:40:58.764924 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 439/869] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:40:58.975065 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b61ad1d1-6452-442c-8361-108044f10dfa tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8b5c7b8f48419ebcae6a1913661afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2700efc5d45119cc13a60bc0f25f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:40:58.982530 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b61ad1d1-6452-442c-8361-108044f10dfa tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] 10.222.0.16 "GET /compute/v2.1/servers/e425f4da-b07f-4931-965f-6edcddab8b8c" status: 200 len: 1314 microversion: 2.1 time: 0.252394 May 23 12:40:58.983094 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 431/870] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:40:58 2022] GET /compute/v2.1/servers/e425f4da-b07f-4931-965f-6edcddab8b8c => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:41:00.001560 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-ae8179b6-a39c-4cb6-8f0e-6b907f308167 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:41:00.002254 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-ae8179b6-a39c-4cb6-8f0e-6b907f308167 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] [instance: e425f4da-b07f-4931-965f-6edcddab8b8c] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:41:00.009375 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ae8179b6-a39c-4cb6-8f0e-6b907f308167 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:00.009819 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ae8179b6-a39c-4cb6-8f0e-6b907f308167 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:00.010583 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ae8179b6-a39c-4cb6-8f0e-6b907f308167 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:00.011065 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ae8179b6-a39c-4cb6-8f0e-6b907f308167 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:00.219168 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-ae8179b6-a39c-4cb6-8f0e-6b907f308167 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8b5c7b8f48419ebcae6a1913661afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2700efc5d45119cc13a60bc0f25f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:41:00.226984 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-ae8179b6-a39c-4cb6-8f0e-6b907f308167 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] 10.222.0.16 "GET /compute/v2.1/servers/e425f4da-b07f-4931-965f-6edcddab8b8c" status: 200 len: 1314 microversion: 2.1 time: 0.230117 May 23 12:41:00.227554 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 440/871] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:40:59 2022] GET /compute/v2.1/servers/e425f4da-b07f-4931-965f-6edcddab8b8c => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:41:01.244494 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-79570534-7610-4440-9758-6a9687870784 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:41:01.245270 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-79570534-7610-4440-9758-6a9687870784 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] [instance: e425f4da-b07f-4931-965f-6edcddab8b8c] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:41:01.251212 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-79570534-7610-4440-9758-6a9687870784 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:01.251664 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-79570534-7610-4440-9758-6a9687870784 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:01.252454 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-79570534-7610-4440-9758-6a9687870784 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:01.252893 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-79570534-7610-4440-9758-6a9687870784 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:01.385769 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-79570534-7610-4440-9758-6a9687870784 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8b5c7b8f48419ebcae6a1913661afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2700efc5d45119cc13a60bc0f25f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:41:01.393308 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-79570534-7610-4440-9758-6a9687870784 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] 10.222.0.16 "GET /compute/v2.1/servers/e425f4da-b07f-4931-965f-6edcddab8b8c" status: 200 len: 1314 microversion: 2.1 time: 0.153698 May 23 12:41:01.393869 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 432/872] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:41:01 2022] GET /compute/v2.1/servers/e425f4da-b07f-4931-965f-6edcddab8b8c => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:41:02.410371 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-0f92bfe1-c6ca-48db-aeae-e760cd41f7ec tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:41:02.411036 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-0f92bfe1-c6ca-48db-aeae-e760cd41f7ec tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] [instance: e425f4da-b07f-4931-965f-6edcddab8b8c] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:41:02.417996 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0f92bfe1-c6ca-48db-aeae-e760cd41f7ec tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:02.418482 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0f92bfe1-c6ca-48db-aeae-e760cd41f7ec tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:02.419284 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0f92bfe1-c6ca-48db-aeae-e760cd41f7ec tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:02.419767 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0f92bfe1-c6ca-48db-aeae-e760cd41f7ec tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:02.554493 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-0f92bfe1-c6ca-48db-aeae-e760cd41f7ec tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8b5c7b8f48419ebcae6a1913661afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2700efc5d45119cc13a60bc0f25f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:41:02.564733 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-0f92bfe1-c6ca-48db-aeae-e760cd41f7ec tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] 10.222.0.16 "GET /compute/v2.1/servers/e425f4da-b07f-4931-965f-6edcddab8b8c" status: 200 len: 1314 microversion: 2.1 time: 0.158366 May 23 12:41:02.565310 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 441/873] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:41:02 2022] GET /compute/v2.1/servers/e425f4da-b07f-4931-965f-6edcddab8b8c => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:41:02.998761 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-551e5d26-1989-429c-8042-6979c89941a1 req-86a99726-0ef3-4677-aab0-92edf2062fe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e425f4da-b07f-4931-965f-6edcddab8b8c", "name": "network-vif-plugged", "status": "completed", "tag": "b044c603-8c60-4064-b5f9-6256664601bf"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:41:03.009519 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-551e5d26-1989-429c-8042-6979c89941a1 req-86a99726-0ef3-4677-aab0-92edf2062fe1 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:03.009985 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-551e5d26-1989-429c-8042-6979c89941a1 req-86a99726-0ef3-4677-aab0-92edf2062fe1 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:03.021932 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-551e5d26-1989-429c-8042-6979c89941a1 req-86a99726-0ef3-4677-aab0-92edf2062fe1 service nova] Creating event network-vif-plugged:b044c603-8c60-4064-b5f9-6256664601bf for instance e425f4da-b07f-4931-965f-6edcddab8b8c on hv-cinder-83699 May 23 12:41:03.028184 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-551e5d26-1989-429c-8042-6979c89941a1 req-86a99726-0ef3-4677-aab0-92edf2062fe1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033156 May 23 12:41:03.029009 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 433/874] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:41:03.583444 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-6210531e-99f0-4d18-83e3-c3d17a8f9c78 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:41:03.584056 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-6210531e-99f0-4d18-83e3-c3d17a8f9c78 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] [instance: e425f4da-b07f-4931-965f-6edcddab8b8c] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:41:03.591701 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6210531e-99f0-4d18-83e3-c3d17a8f9c78 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:03.592209 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6210531e-99f0-4d18-83e3-c3d17a8f9c78 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:03.593035 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6210531e-99f0-4d18-83e3-c3d17a8f9c78 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:03.593522 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6210531e-99f0-4d18-83e3-c3d17a8f9c78 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:03.729404 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-6210531e-99f0-4d18-83e3-c3d17a8f9c78 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8b5c7b8f48419ebcae6a1913661afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2700efc5d45119cc13a60bc0f25f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:41:03.736844 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-6210531e-99f0-4d18-83e3-c3d17a8f9c78 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] 10.222.0.16 "GET /compute/v2.1/servers/e425f4da-b07f-4931-965f-6edcddab8b8c" status: 200 len: 1314 microversion: 2.1 time: 0.157593 May 23 12:41:03.737408 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 442/875] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:41:03 2022] GET /compute/v2.1/servers/e425f4da-b07f-4931-965f-6edcddab8b8c => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:41:04.753450 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-cef1b9a6-b169-4e27-b864-31640edd43f2 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:41:04.754189 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-cef1b9a6-b169-4e27-b864-31640edd43f2 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] [instance: e425f4da-b07f-4931-965f-6edcddab8b8c] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:41:04.762087 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cef1b9a6-b169-4e27-b864-31640edd43f2 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:04.762536 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cef1b9a6-b169-4e27-b864-31640edd43f2 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:04.763308 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cef1b9a6-b169-4e27-b864-31640edd43f2 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:04.763761 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cef1b9a6-b169-4e27-b864-31640edd43f2 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:04.894967 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-cef1b9a6-b169-4e27-b864-31640edd43f2 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8b5c7b8f48419ebcae6a1913661afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2700efc5d45119cc13a60bc0f25f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:41:04.903452 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-cef1b9a6-b169-4e27-b864-31640edd43f2 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] 10.222.0.16 "GET /compute/v2.1/servers/e425f4da-b07f-4931-965f-6edcddab8b8c" status: 200 len: 1496 microversion: 2.1 time: 0.154204 May 23 12:41:04.904028 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 434/876] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:41:04 2022] GET /compute/v2.1/servers/e425f4da-b07f-4931-965f-6edcddab8b8c => generated 1496 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:41:05.328080 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-5c484d63-0a8f-427f-b99a-7184175ff2fd tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:41:05.328635 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-5c484d63-0a8f-427f-b99a-7184175ff2fd tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] [instance: e425f4da-b07f-4931-965f-6edcddab8b8c] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:41:05.335383 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5c484d63-0a8f-427f-b99a-7184175ff2fd tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:05.335833 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5c484d63-0a8f-427f-b99a-7184175ff2fd tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:05.336629 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5c484d63-0a8f-427f-b99a-7184175ff2fd tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:05.337069 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5c484d63-0a8f-427f-b99a-7184175ff2fd tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:05.363125 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-5c484d63-0a8f-427f-b99a-7184175ff2fd tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] [instance: e425f4da-b07f-4931-965f-6edcddab8b8c] Going to try to terminate instance {{(pid=124200) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 12:41:05.436146 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-5c484d63-0a8f-427f-b99a-7184175ff2fd tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e425f4da-b07f-4931-965f-6edcddab8b8c" status: 204 len: 0 microversion: 2.1 time: 0.111696 May 23 12:41:05.436787 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 443/877] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 12:41:05 2022] DELETE /compute/v2.1/servers/e425f4da-b07f-4931-965f-6edcddab8b8c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 12:41:05.446961 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-a93a24fe-fd8c-4fba-a95b-bbbe163b2a89 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:41:05.447679 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-a93a24fe-fd8c-4fba-a95b-bbbe163b2a89 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] [instance: e425f4da-b07f-4931-965f-6edcddab8b8c] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:41:05.455108 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a93a24fe-fd8c-4fba-a95b-bbbe163b2a89 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:05.455555 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a93a24fe-fd8c-4fba-a95b-bbbe163b2a89 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:05.456348 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a93a24fe-fd8c-4fba-a95b-bbbe163b2a89 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:05.456787 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a93a24fe-fd8c-4fba-a95b-bbbe163b2a89 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:05.590097 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-a93a24fe-fd8c-4fba-a95b-bbbe163b2a89 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8b5c7b8f48419ebcae6a1913661afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2700efc5d45119cc13a60bc0f25f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:41:05.597455 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-a93a24fe-fd8c-4fba-a95b-bbbe163b2a89 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] 10.222.0.16 "GET /compute/v2.1/servers/e425f4da-b07f-4931-965f-6edcddab8b8c" status: 200 len: 1502 microversion: 2.1 time: 0.156330 May 23 12:41:05.598009 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 435/878] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:41:05 2022] GET /compute/v2.1/servers/e425f4da-b07f-4931-965f-6edcddab8b8c => generated 1502 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:41:06.615292 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-2618b85d-3a78-4175-a6fe-6e4cd120d458 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:41:06.615993 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-2618b85d-3a78-4175-a6fe-6e4cd120d458 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] [instance: e425f4da-b07f-4931-965f-6edcddab8b8c] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:41:06.618476 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell0:SELECT=2 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:41:06.623882 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2618b85d-3a78-4175-a6fe-6e4cd120d458 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:06.624311 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2618b85d-3a78-4175-a6fe-6e4cd120d458 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:06.625202 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2618b85d-3a78-4175-a6fe-6e4cd120d458 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:06.625533 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-2618b85d-3a78-4175-a6fe-6e4cd120d458 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:06.785867 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-2618b85d-3a78-4175-a6fe-6e4cd120d458 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8b5c7b8f48419ebcae6a1913661afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2700efc5d45119cc13a60bc0f25f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:41:06.793658 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-2618b85d-3a78-4175-a6fe-6e4cd120d458 tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] 10.222.0.16 "GET /compute/v2.1/servers/e425f4da-b07f-4931-965f-6edcddab8b8c" status: 200 len: 1502 microversion: 2.1 time: 0.182584 May 23 12:41:06.794231 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 444/879] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:41:06 2022] GET /compute/v2.1/servers/e425f4da-b07f-4931-965f-6edcddab8b8c => generated 1502 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:41:07.486742 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-b373ddda-6b66-4813-9a2c-0ae18043163b req-b40316ca-06cf-4018-b557-7b31fe60ceea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e425f4da-b07f-4931-965f-6edcddab8b8c", "name": "network-vif-deleted", "tag": "b044c603-8c60-4064-b5f9-6256664601bf"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:41:07.490799 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell0:SELECT=2 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:41:07.491761 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell0:SELECT=6 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:41:07.499133 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-b373ddda-6b66-4813-9a2c-0ae18043163b req-b40316ca-06cf-4018-b557-7b31fe60ceea service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:07.499578 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-b373ddda-6b66-4813-9a2c-0ae18043163b req-b40316ca-06cf-4018-b557-7b31fe60ceea service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:07.512333 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-b373ddda-6b66-4813-9a2c-0ae18043163b req-b40316ca-06cf-4018-b557-7b31fe60ceea service nova] Creating event network-vif-deleted:b044c603-8c60-4064-b5f9-6256664601bf for instance e425f4da-b07f-4931-965f-6edcddab8b8c on hv-cinder-83699 May 23 12:41:07.517376 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-b373ddda-6b66-4813-9a2c-0ae18043163b req-b40316ca-06cf-4018-b557-7b31fe60ceea service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034408 May 23 12:41:07.517968 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 436/880] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:41:07.813085 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-97af1092-eff4-4a8a-800b-e3f410d91a5b tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:41:07.813670 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-97af1092-eff4-4a8a-800b-e3f410d91a5b tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] [instance: e425f4da-b07f-4931-965f-6edcddab8b8c] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:41:07.822151 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-97af1092-eff4-4a8a-800b-e3f410d91a5b tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:07.822613 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-97af1092-eff4-4a8a-800b-e3f410d91a5b tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:07.823663 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-97af1092-eff4-4a8a-800b-e3f410d91a5b tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:07.824353 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-97af1092-eff4-4a8a-800b-e3f410d91a5b tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:07.857213 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-97af1092-eff4-4a8a-800b-e3f410d91a5b tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:07.857658 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-97af1092-eff4-4a8a-800b-e3f410d91a5b tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:07.858102 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.objects.instance [None req-97af1092-eff4-4a8a-800b-e3f410d91a5b tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lazy-loading 'fault' on Instance uuid e425f4da-b07f-4931-965f-6edcddab8b8c {{(pid=124200) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:41:07.899558 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-97af1092-eff4-4a8a-800b-e3f410d91a5b tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8b5c7b8f48419ebcae6a1913661afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f2700efc5d45119cc13a60bc0f25f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:41:07.908154 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-97af1092-eff4-4a8a-800b-e3f410d91a5b tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] 10.222.0.16 "GET /compute/v2.1/servers/e425f4da-b07f-4931-965f-6edcddab8b8c" status: 200 len: 1304 microversion: 2.1 time: 0.099570 May 23 12:41:07.908749 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 445/881] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:41:07 2022] GET /compute/v2.1/servers/e425f4da-b07f-4931-965f-6edcddab8b8c => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:41:08.927388 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-9b8d6989-df23-40ad-b4be-a5c7d3d8744c tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:41:08.928076 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-9b8d6989-df23-40ad-b4be-a5c7d3d8744c tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] [instance: e425f4da-b07f-4931-965f-6edcddab8b8c] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:41:08.930747 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:41:08.936568 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9b8d6989-df23-40ad-b4be-a5c7d3d8744c tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:08.937012 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9b8d6989-df23-40ad-b4be-a5c7d3d8744c tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:08.937798 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9b8d6989-df23-40ad-b4be-a5c7d3d8744c tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:08.938232 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9b8d6989-df23-40ad-b4be-a5c7d3d8744c tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:08.953204 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.wsgi [None req-9b8d6989-df23-40ad-b4be-a5c7d3d8744c tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] HTTP exception thrown: Instance e425f4da-b07f-4931-965f-6edcddab8b8c could not be found. May 23 12:41:08.955066 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-9b8d6989-df23-40ad-b4be-a5c7d3d8744c tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Request method failure captured: May 23 12:41:08.955066 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: request: GET /compute/v2.1/servers/e425f4da-b07f-4931-965f-6edcddab8b8c HTTP/1.1 May 23 12:41:08.955066 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept: application/json May 23 12:41:08.955066 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept-Encoding: identity May 23 12:41:08.955066 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Connection: close May 23 12:41:08.955066 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Length: 0 May 23 12:41:08.955066 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Type: application/json May 23 12:41:08.955066 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Host: 10.222.0.16 May 23 12:41:08.955066 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Openstack-System-Scope: None May 23 12:41:08.955066 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: User-Agent: python-urllib3/1.26.9 May 23 12:41:08.955066 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Auth-Token: gAAAAABii4C-b8I_ghTqH_mkrxhkP3uOzib58kySR747ujzuhePrGUqGkAtSllEtSmZGNMSIww4nM-wGpn0rlU_XNCbnLMyfYyf-SxKLx4XOqgKCPO_sbtql10_UJ_yNvU5auTvmqvnIffipqffCkAZ3jiVbfyHOyebrxnXJQsDu-HxzME4w84o May 23 12:41:08.955066 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Id: None May 23 12:41:08.955066 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Name: None May 23 12:41:08.955066 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Identity-Status: Confirmed May 23 12:41:08.955066 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Is-Admin-Project: True May 23 12:41:08.955066 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Id: default May 23 12:41:08.955066 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Name: Default May 23 12:41:08.955066 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Id: c1f2700efc5d45119cc13a60bc0f25f0 May 23 12:41:08.955066 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Name: tempest-VolumesActionsTest-208212068 May 23 12:41:08.955066 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Role: member,reader May 23 12:41:08.955066 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Roles: member,reader May 23 12:41:08.956525 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c1f2700efc5d45119cc13a60bc0f25f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c1f2700efc5d45119cc13a60bc0f25f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c1f2700efc5d45119cc13a60bc0f25f0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c1f2700efc5d45119cc13a60bc0f25f0"}]}] May 23 12:41:08.956525 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant: tempest-VolumesActionsTest-208212068 May 23 12:41:08.956525 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Id: c1f2700efc5d45119cc13a60bc0f25f0 May 23 12:41:08.956525 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Name: tempest-VolumesActionsTest-208212068 May 23 12:41:08.956525 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User: tempest-VolumesActionsTest-208212068-project May 23 12:41:08.956525 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Id: default May 23 12:41:08.956525 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Name: Default May 23 12:41:08.956525 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Id: be8b5c7b8f48419ebcae6a1913661afa May 23 12:41:08.956525 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Name: tempest-VolumesActionsTest-208212068-project May 23 12:41:08.956525 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: method: > May 23 12:41:08.956525 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: exception: Instance e425f4da-b07f-4931-965f-6edcddab8b8c could not be found. May 23 12:41:08.956525 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: action_args: {'id': 'e425f4da-b07f-4931-965f-6edcddab8b8c'} May 23 12:41:08.957387 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:41:08.957387 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:41:08.957387 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:41:08.957387 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:41:08.957387 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:41:08.957387 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:41:08.957387 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:41:08.957387 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:41:08.957387 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:41:08.957387 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:41:08.957387 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e425f4da-b07f-4931-965f-6edcddab8b8c could not be found. May 23 12:41:08.957387 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:41:08.957387 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:41:08.957387 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:41:08.957387 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:41:08.957387 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:41:08.957387 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:41:08.957387 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:41:08.957387 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:41:08.957387 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:41:08.958943 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:41:08.958943 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:41:08.958943 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:41:08.958943 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:41:08.958943 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:41:08.958943 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:41:08.958943 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:41:08.958943 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e425f4da-b07f-4931-965f-6edcddab8b8c could not be found. May 23 12:41:08.958943 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:41:08.958943 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:41:08.958943 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:41:08.958943 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:41:08.958943 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:41:08.958943 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:41:08.958943 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:41:08.958943 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:41:08.958943 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e425f4da-b07f-4931-965f-6edcddab8b8c could not be found. May 23 12:41:08.958943 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:41:08.961051 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-9b8d6989-df23-40ad-b4be-a5c7d3d8744c tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] Returning 404 to user: Instance e425f4da-b07f-4931-965f-6edcddab8b8c could not be found. {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:41:08.961051 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-9b8d6989-df23-40ad-b4be-a5c7d3d8744c tempest-VolumesActionsTest-208212068 tempest-VolumesActionsTest-208212068-project] 10.222.0.16 "GET /compute/v2.1/servers/e425f4da-b07f-4931-965f-6edcddab8b8c" status: 404 len: 111 microversion: 2.1 time: 0.033280 May 23 12:41:08.961051 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 437/882] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:41:08 2022] GET /compute/v2.1/servers/e425f4da-b07f-4931-965f-6edcddab8b8c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:41:12.755425 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-9c625943-c9ea-40ee-8a76-d02c2c965d11 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:41:12.756767 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-9c625943-c9ea-40ee-8a76-d02c2c965d11 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:41:12.765497 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9c625943-c9ea-40ee-8a76-d02c2c965d11 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:12.774238 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9c625943-c9ea-40ee-8a76-d02c2c965d11 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:12.775295 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9c625943-c9ea-40ee-8a76-d02c2c965d11 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:12.775754 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9c625943-c9ea-40ee-8a76-d02c2c965d11 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:12.791186 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:41:12.814566 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-9c625943-c9ea-40ee-8a76-d02c2c965d11 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.066065 May 23 12:41:12.815164 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 446/883] 10.222.0.16 () {60 vars in 1342 bytes} [Mon May 23 12:41:12 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:41:12.878387 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-e301dc2f-334c-452c-9e36-e932ba59cc3f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:41:12.879511 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-e301dc2f-334c-452c-9e36-e932ba59cc3f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:41:12.886662 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e301dc2f-334c-452c-9e36-e932ba59cc3f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:12.887377 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e301dc2f-334c-452c-9e36-e932ba59cc3f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:12.888155 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e301dc2f-334c-452c-9e36-e932ba59cc3f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:12.888613 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e301dc2f-334c-452c-9e36-e932ba59cc3f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:12.919499 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-e301dc2f-334c-452c-9e36-e932ba59cc3f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Going to try to terminate instance {{(pid=124199) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 12:41:13.006527 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-e301dc2f-334c-452c-9e36-e932ba59cc3f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "DELETE /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 204 len: 0 microversion: 2.20 time: 0.131757 May 23 12:41:13.007340 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 438/884] 10.222.0.16 () {60 vars in 1279 bytes} [Mon May 23 12:41:12 2022] DELETE /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 23 12:41:13.016657 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-ed349bf6-3211-45b9-883d-84769a5c75b6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:41:13.017267 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-ed349bf6-3211-45b9-883d-84769a5c75b6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:41:13.031283 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ed349bf6-3211-45b9-883d-84769a5c75b6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:13.031939 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ed349bf6-3211-45b9-883d-84769a5c75b6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:13.033109 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ed349bf6-3211-45b9-883d-84769a5c75b6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:13.033354 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ed349bf6-3211-45b9-883d-84769a5c75b6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:13.177625 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-ed349bf6-3211-45b9-883d-84769a5c75b6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:41:13.186639 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-ed349bf6-3211-45b9-883d-84769a5c75b6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:41:13.188333 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-ed349bf6-3211-45b9-883d-84769a5c75b6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:41:13.189606 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-ed349bf6-3211-45b9-883d-84769a5c75b6 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.177764 May 23 12:41:13.190261 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 447/885] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:41:13 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:41:14.120403 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-34d00514-6fd6-4b1a-a12c-9b8991436b29 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:41:14.121511 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-34d00514-6fd6-4b1a-a12c-9b8991436b29 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:41:14.122768 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-c97bc2f0-dd98-40ac-92e9-c7faf5f09fbd req-9e05b538-8802-481c-9c6f-a16fdc611bdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1acfc6ec-6e8f-4969-99e8-0de456fcb7ed", "tag": "6629f354-c1e7-44f4-90fa-1e340bce002d"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:41:14.126502 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:41:14.135633 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-c97bc2f0-dd98-40ac-92e9-c7faf5f09fbd req-9e05b538-8802-481c-9c6f-a16fdc611bdc service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:14.136416 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-c97bc2f0-dd98-40ac-92e9-c7faf5f09fbd req-9e05b538-8802-481c-9c6f-a16fdc611bdc service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:14.138425 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-34d00514-6fd6-4b1a-a12c-9b8991436b29 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:14.139045 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-34d00514-6fd6-4b1a-a12c-9b8991436b29 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:14.140086 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-34d00514-6fd6-4b1a-a12c-9b8991436b29 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:14.148875 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-34d00514-6fd6-4b1a-a12c-9b8991436b29 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:14.151491 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-c97bc2f0-dd98-40ac-92e9-c7faf5f09fbd req-9e05b538-8802-481c-9c6f-a16fdc611bdc service nova] Creating event network-changed:6629f354-c1e7-44f4-90fa-1e340bce002d for instance 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed on hv-cinder-83699 May 23 12:41:14.157353 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-c97bc2f0-dd98-40ac-92e9-c7faf5f09fbd req-9e05b538-8802-481c-9c6f-a16fdc611bdc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039600 May 23 12:41:14.158546 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 448/886] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:41:14.210549 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-f9e02556-e7c6-448c-9609-a29b5f1e0beb tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:41:14.211936 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-f9e02556-e7c6-448c-9609-a29b5f1e0beb tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:41:14.227696 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f9e02556-e7c6-448c-9609-a29b5f1e0beb tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:14.245703 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-34d00514-6fd6-4b1a-a12c-9b8991436b29 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Going to try to terminate instance {{(pid=124199) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 12:41:14.247290 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f9e02556-e7c6-448c-9609-a29b5f1e0beb tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:14.252851 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f9e02556-e7c6-448c-9609-a29b5f1e0beb tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:14.254181 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f9e02556-e7c6-448c-9609-a29b5f1e0beb tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:14.466695 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-34d00514-6fd6-4b1a-a12c-9b8991436b29 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 204 len: 0 microversion: 2.1 time: 0.353791 May 23 12:41:14.470985 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 439/887] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 12:41:14 2022] DELETE /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 12:41:14.481864 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-e88e36fe-f931-4502-b334-0beaf9939259 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:41:14.482785 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-e88e36fe-f931-4502-b334-0beaf9939259 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:41:14.511716 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e88e36fe-f931-4502-b334-0beaf9939259 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:14.513264 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e88e36fe-f931-4502-b334-0beaf9939259 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:14.515910 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e88e36fe-f931-4502-b334-0beaf9939259 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:14.517216 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e88e36fe-f931-4502-b334-0beaf9939259 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:14.663940 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-f9e02556-e7c6-448c-9609-a29b5f1e0beb tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:41:14.684545 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-f9e02556-e7c6-448c-9609-a29b5f1e0beb tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:41:14.687002 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-f9e02556-e7c6-448c-9609-a29b5f1e0beb tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:41:14.688856 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-f9e02556-e7c6-448c-9609-a29b5f1e0beb tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.482577 May 23 12:41:14.700663 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 449/888] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:41:14 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:41:14.785418 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-e88e36fe-f931-4502-b334-0beaf9939259 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:41:14.795769 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-e88e36fe-f931-4502-b334-0beaf9939259 tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1568 microversion: 2.1 time: 0.322168 May 23 12:41:14.808649 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 440/889] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:41:14 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1568 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:41:15.711611 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-b163b54e-9603-4a14-b90e-44f3cb45356f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:41:15.712923 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-b163b54e-9603-4a14-b90e-44f3cb45356f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:41:15.732978 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b163b54e-9603-4a14-b90e-44f3cb45356f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:15.733428 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b163b54e-9603-4a14-b90e-44f3cb45356f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:15.734219 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b163b54e-9603-4a14-b90e-44f3cb45356f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:15.734661 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b163b54e-9603-4a14-b90e-44f3cb45356f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:15.818925 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-6ae52b1b-89a0-4b1c-a28d-4ab2328b9c2a tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:41:15.819543 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-6ae52b1b-89a0-4b1c-a28d-4ab2328b9c2a tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:41:15.834386 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6ae52b1b-89a0-4b1c-a28d-4ab2328b9c2a tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:15.835107 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6ae52b1b-89a0-4b1c-a28d-4ab2328b9c2a tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:15.836740 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6ae52b1b-89a0-4b1c-a28d-4ab2328b9c2a tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:15.838615 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6ae52b1b-89a0-4b1c-a28d-4ab2328b9c2a tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:16.039727 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-b163b54e-9603-4a14-b90e-44f3cb45356f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:41:16.050912 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-b163b54e-9603-4a14-b90e-44f3cb45356f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:41:16.052724 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-b163b54e-9603-4a14-b90e-44f3cb45356f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:41:16.054124 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-b163b54e-9603-4a14-b90e-44f3cb45356f tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1724 microversion: 2.20 time: 0.349982 May 23 12:41:16.055235 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 450/890] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:41:15 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1724 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:41:16.190905 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-6ae52b1b-89a0-4b1c-a28d-4ab2328b9c2a tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:41:16.205858 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-6ae52b1b-89a0-4b1c-a28d-4ab2328b9c2a tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1568 microversion: 2.1 time: 0.392631 May 23 12:41:16.207035 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 441/891] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:41:15 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1568 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:41:16.911037 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-6bd73056-2eb0-430f-956c-b2c7eb8a5788 req-fb32b15d-c03a-4f8f-87f3-cdf09db0670b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1acfc6ec-6e8f-4969-99e8-0de456fcb7ed", "name": "network-vif-deleted", "tag": "6629f354-c1e7-44f4-90fa-1e340bce002d"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:41:16.934520 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-6bd73056-2eb0-430f-956c-b2c7eb8a5788 req-fb32b15d-c03a-4f8f-87f3-cdf09db0670b service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:16.934987 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-6bd73056-2eb0-430f-956c-b2c7eb8a5788 req-fb32b15d-c03a-4f8f-87f3-cdf09db0670b service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:16.964201 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-6bd73056-2eb0-430f-956c-b2c7eb8a5788 req-fb32b15d-c03a-4f8f-87f3-cdf09db0670b service nova] Creating event network-vif-deleted:6629f354-c1e7-44f4-90fa-1e340bce002d for instance 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed on hv-cinder-83699 May 23 12:41:16.994655 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-6bd73056-2eb0-430f-956c-b2c7eb8a5788 req-fb32b15d-c03a-4f8f-87f3-cdf09db0670b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087850 May 23 12:41:16.995281 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 451/892] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:41:17.073355 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d06b0423-6614-4a65-9832-0beb5f97f7da tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:41:17.074474 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d06b0423-6614-4a65-9832-0beb5f97f7da tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:41:17.089951 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d06b0423-6614-4a65-9832-0beb5f97f7da tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:17.090657 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d06b0423-6614-4a65-9832-0beb5f97f7da tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:17.091649 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d06b0423-6614-4a65-9832-0beb5f97f7da tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:17.092309 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d06b0423-6614-4a65-9832-0beb5f97f7da tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:17.120614 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-32f678ce-3b53-4d14-8d41-9d57119c1d35 req-79b4e3ef-9c59-4f9a-a026-05bb6ca8bbfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40320b2c-6137-4266-b3b6-fb76f3d6d654", "name": "network-vif-deleted", "tag": "c581b4f8-de6e-4314-a04e-aca7063e49e5"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:41:17.142447 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-32f678ce-3b53-4d14-8d41-9d57119c1d35 req-79b4e3ef-9c59-4f9a-a026-05bb6ca8bbfe service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:17.143033 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-32f678ce-3b53-4d14-8d41-9d57119c1d35 req-79b4e3ef-9c59-4f9a-a026-05bb6ca8bbfe service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:17.174776 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-32f678ce-3b53-4d14-8d41-9d57119c1d35 req-79b4e3ef-9c59-4f9a-a026-05bb6ca8bbfe service nova] Creating event network-vif-deleted:c581b4f8-de6e-4314-a04e-aca7063e49e5 for instance 40320b2c-6137-4266-b3b6-fb76f3d6d654 on hv-cinder-83699 May 23 12:41:17.182840 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-32f678ce-3b53-4d14-8d41-9d57119c1d35 req-79b4e3ef-9c59-4f9a-a026-05bb6ca8bbfe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067648 May 23 12:41:17.183986 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 452/893] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:41:17.237023 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-202f187d-cc62-44ff-9073-97cd6b9a64db tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:41:17.238290 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-202f187d-cc62-44ff-9073-97cd6b9a64db tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:41:17.273213 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d06b0423-6614-4a65-9832-0beb5f97f7da tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:41:17.285067 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-202f187d-cc62-44ff-9073-97cd6b9a64db tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:17.286941 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-202f187d-cc62-44ff-9073-97cd6b9a64db tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:17.290295 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-202f187d-cc62-44ff-9073-97cd6b9a64db tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:17.297636 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d06b0423-6614-4a65-9832-0beb5f97f7da tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:41:17.299488 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-202f187d-cc62-44ff-9073-97cd6b9a64db tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:17.300735 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d06b0423-6614-4a65-9832-0beb5f97f7da tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:41:17.309032 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d06b0423-6614-4a65-9832-0beb5f97f7da tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1656 microversion: 2.20 time: 0.240633 May 23 12:41:17.310047 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 442/894] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:41:17 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1656 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:41:17.418049 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-202f187d-cc62-44ff-9073-97cd6b9a64db tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921861792ac246aa8772a636d45489c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f4c15c26e47b7ba55aca85bfb66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:41:17.436827 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-202f187d-cc62-44ff-9073-97cd6b9a64db tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 200 len: 1219 microversion: 2.1 time: 0.209832 May 23 12:41:17.438020 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 453/895] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:41:17 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 1219 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:41:18.332636 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-992f4004-41a7-45de-9c2a-2c0ff4923a3b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:41:18.334005 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-992f4004-41a7-45de-9c2a-2c0ff4923a3b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:41:18.350424 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-992f4004-41a7-45de-9c2a-2c0ff4923a3b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:18.355237 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-992f4004-41a7-45de-9c2a-2c0ff4923a3b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:18.355737 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-992f4004-41a7-45de-9c2a-2c0ff4923a3b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:18.358276 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-992f4004-41a7-45de-9c2a-2c0ff4923a3b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:18.396391 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-992f4004-41a7-45de-9c2a-2c0ff4923a3b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:18.396643 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-992f4004-41a7-45de-9c2a-2c0ff4923a3b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:18.397289 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.objects.instance [None req-992f4004-41a7-45de-9c2a-2c0ff4923a3b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lazy-loading 'fault' on Instance uuid 40320b2c-6137-4266-b3b6-fb76f3d6d654 {{(pid=124199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:41:18.463895 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-90aa5e03-43fb-4855-a635-e1ac8b3f496d tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:41:18.464742 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-90aa5e03-43fb-4855-a635-e1ac8b3f496d tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] [instance: 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:41:18.485511 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-992f4004-41a7-45de-9c2a-2c0ff4923a3b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:41:18.488228 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-90aa5e03-43fb-4855-a635-e1ac8b3f496d tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:18.489905 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-90aa5e03-43fb-4855-a635-e1ac8b3f496d tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:18.491392 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-90aa5e03-43fb-4855-a635-e1ac8b3f496d tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:18.492977 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-90aa5e03-43fb-4855-a635-e1ac8b3f496d tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:18.499148 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-992f4004-41a7-45de-9c2a-2c0ff4923a3b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:41:18.501041 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-992f4004-41a7-45de-9c2a-2c0ff4923a3b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '851454212d14438d80bf8e193fea268e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0502b9ef01e2460893cfc855d44db0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:41:18.502411 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-992f4004-41a7-45de-9c2a-2c0ff4923a3b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 200 len: 1371 microversion: 2.20 time: 0.179107 May 23 12:41:18.502963 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 443/896] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:41:18 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 1371 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:41:18.511756 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.wsgi [None req-90aa5e03-43fb-4855-a635-e1ac8b3f496d tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] HTTP exception thrown: Instance 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed could not be found. May 23 12:41:18.521332 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-90aa5e03-43fb-4855-a635-e1ac8b3f496d tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Request method failure captured: May 23 12:41:18.521332 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: request: GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed HTTP/1.1 May 23 12:41:18.521332 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept: application/json May 23 12:41:18.521332 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept-Encoding: identity May 23 12:41:18.521332 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Connection: close May 23 12:41:18.521332 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Length: 0 May 23 12:41:18.521332 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Type: application/json May 23 12:41:18.521332 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Host: 10.222.0.16 May 23 12:41:18.521332 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Openstack-System-Scope: None May 23 12:41:18.521332 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: User-Agent: python-urllib3/1.26.9 May 23 12:41:18.521332 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Auth-Token: gAAAAABii3-jd4ywCt0jL8Ra6yUzsz9tWKcuHCsl0uQF53t5yyQzmLkyXtOUoeQZh5uI6U8fafGiR87vJIzlGHqiDZ2yYNu00IsI8VGMG5Td_gWNUd-tlLg-0qFfwIFbTM5OK2_Uv0jazXKaRB6JUyPZdjdXL5u_1b89oHJp3qK7b0lSPgvu53Y May 23 12:41:18.521332 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Id: None May 23 12:41:18.521332 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Name: None May 23 12:41:18.521332 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Identity-Status: Confirmed May 23 12:41:18.521332 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Is-Admin-Project: True May 23 12:41:18.521332 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Id: default May 23 12:41:18.521332 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Name: Default May 23 12:41:18.521332 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Id: 835f4c15c26e47b7ba55aca85bfb66a8 May 23 12:41:18.521332 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Name: tempest-TestShelveInstance-287373493 May 23 12:41:18.521332 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Role: member,reader May 23 12:41:18.521332 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Roles: member,reader May 23 12:41:18.522776 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/835f4c15c26e47b7ba55aca85bfb66a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/835f4c15c26e47b7ba55aca85bfb66a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_835f4c15c26e47b7ba55aca85bfb66a8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/835f4c15c26e47b7ba55aca85bfb66a8"}]}] May 23 12:41:18.522776 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant: tempest-TestShelveInstance-287373493 May 23 12:41:18.522776 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Id: 835f4c15c26e47b7ba55aca85bfb66a8 May 23 12:41:18.522776 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Name: tempest-TestShelveInstance-287373493 May 23 12:41:18.522776 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User: tempest-TestShelveInstance-287373493-project May 23 12:41:18.522776 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Id: default May 23 12:41:18.522776 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Name: Default May 23 12:41:18.522776 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Id: 921861792ac246aa8772a636d45489c8 May 23 12:41:18.522776 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Name: tempest-TestShelveInstance-287373493-project May 23 12:41:18.522776 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: method: > May 23 12:41:18.522776 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: exception: Instance 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed could not be found. May 23 12:41:18.522776 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: action_args: {'id': '1acfc6ec-6e8f-4969-99e8-0de456fcb7ed'} May 23 12:41:18.524267 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:41:18.524267 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:41:18.524267 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:41:18.524267 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:41:18.524267 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:41:18.524267 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:41:18.524267 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:41:18.524267 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:41:18.524267 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:41:18.524267 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:41:18.524267 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed could not be found. May 23 12:41:18.524267 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:41:18.524267 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:41:18.524267 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:41:18.524267 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:41:18.524267 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:41:18.524267 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:41:18.524267 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:41:18.524267 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:41:18.524267 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:41:18.525931 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:41:18.525931 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:41:18.525931 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:41:18.525931 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:41:18.525931 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:41:18.525931 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:41:18.525931 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:41:18.525931 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed could not be found. May 23 12:41:18.525931 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:41:18.525931 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:41:18.525931 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:41:18.525931 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:41:18.525931 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:41:18.525931 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:41:18.525931 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:41:18.525931 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:41:18.525931 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed could not be found. May 23 12:41:18.525931 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:41:18.528348 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-90aa5e03-43fb-4855-a635-e1ac8b3f496d tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Returning 404 to user: Instance 1acfc6ec-6e8f-4969-99e8-0de456fcb7ed could not be found. {{(pid=124200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:41:18.528348 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-90aa5e03-43fb-4855-a635-e1ac8b3f496d tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed" status: 404 len: 111 microversion: 2.1 time: 0.069209 May 23 12:41:18.528348 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 454/897] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:41:18 2022] GET /compute/v2.1/servers/1acfc6ec-6e8f-4969-99e8-0de456fcb7ed => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:41:18.779902 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-48a9ed3d-bea8-4dcc-856d-03e5acde380c tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] Calling method '.version_select at 0x7f095d258d30>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:41:18.818908 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-48a9ed3d-bea8-4dcc-856d-03e5acde380c tempest-TestShelveInstance-287373493 tempest-TestShelveInstance-287373493-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-956008445" status: 202 len: 0 microversion: 2.1 time: 0.043194 May 23 12:41:18.827920 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 444/898] 10.222.0.16 () {58 vars in 1250 bytes} [Mon May 23 12:41:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-956008445 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:41:19.521868 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-3e8405ac-6a5c-4b67-a79b-a1242bdf8dc3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:41:19.524534 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-3e8405ac-6a5c-4b67-a79b-a1242bdf8dc3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:41:19.531880 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3e8405ac-6a5c-4b67-a79b-a1242bdf8dc3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:19.532563 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3e8405ac-6a5c-4b67-a79b-a1242bdf8dc3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:19.533848 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3e8405ac-6a5c-4b67-a79b-a1242bdf8dc3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:19.534383 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3e8405ac-6a5c-4b67-a79b-a1242bdf8dc3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:19.551572 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.wsgi [None req-3e8405ac-6a5c-4b67-a79b-a1242bdf8dc3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] HTTP exception thrown: Instance 40320b2c-6137-4266-b3b6-fb76f3d6d654 could not be found. May 23 12:41:19.553246 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-3e8405ac-6a5c-4b67-a79b-a1242bdf8dc3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Request method failure captured: May 23 12:41:19.553246 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: request: GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 HTTP/1.1 May 23 12:41:19.553246 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept: application/json May 23 12:41:19.553246 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept-Encoding: identity May 23 12:41:19.553246 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Connection: close May 23 12:41:19.553246 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Length: 0 May 23 12:41:19.553246 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Type: application/json May 23 12:41:19.553246 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Host: 10.222.0.16 May 23 12:41:19.553246 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Openstack-System-Scope: None May 23 12:41:19.553246 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: User-Agent: python-urllib3/1.26.9 May 23 12:41:19.553246 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Auth-Token: gAAAAABii38UOn58rNAdiNYAPjH0omFFBsaNaO8_pzVIuQn4neM6lIxk4S5ERtpR-eO0Z7jfaS2HOB2FTPvEWVBv6qhuXlTO9wLieACj5bJof4If4yf5xtcblLcy8Aiwr6POOlbjhYtACwGg5Koy8rvnyA52MZqFVQGqLr0AWRd9UPIeyfBiuuU May 23 12:41:19.553246 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Id: None May 23 12:41:19.553246 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Name: None May 23 12:41:19.553246 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Identity-Status: Confirmed May 23 12:41:19.553246 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Is-Admin-Project: True May 23 12:41:19.553246 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Openstack-Nova-Api-Version: 2.20 May 23 12:41:19.553246 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Id: default May 23 12:41:19.553246 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Name: Default May 23 12:41:19.553246 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Id: 0502b9ef01e2460893cfc855d44db0c7 May 23 12:41:19.553246 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-457595946 May 23 12:41:19.553246 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Role: member,reader May 23 12:41:19.553246 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Roles: member,reader May 23 12:41:19.554815 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0502b9ef01e2460893cfc855d44db0c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0502b9ef01e2460893cfc855d44db0c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0502b9ef01e2460893cfc855d44db0c7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0502b9ef01e2460893cfc855d44db0c7"}]}] May 23 12:41:19.554815 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant: tempest-AttachVolumeShelveTestJSON-457595946 May 23 12:41:19.554815 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Id: 0502b9ef01e2460893cfc855d44db0c7 May 23 12:41:19.554815 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-457595946 May 23 12:41:19.554815 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User: tempest-AttachVolumeShelveTestJSON-457595946-project May 23 12:41:19.554815 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Id: default May 23 12:41:19.554815 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Name: Default May 23 12:41:19.554815 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Id: 851454212d14438d80bf8e193fea268e May 23 12:41:19.554815 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Name: tempest-AttachVolumeShelveTestJSON-457595946-project May 23 12:41:19.554815 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: method: > May 23 12:41:19.554815 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: exception: Instance 40320b2c-6137-4266-b3b6-fb76f3d6d654 could not be found. May 23 12:41:19.554815 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: action_args: {'id': '40320b2c-6137-4266-b3b6-fb76f3d6d654'} May 23 12:41:19.555864 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:41:19.555864 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:41:19.555864 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:41:19.555864 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:41:19.555864 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:41:19.555864 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:41:19.555864 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:41:19.555864 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:41:19.555864 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:41:19.555864 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:41:19.555864 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40320b2c-6137-4266-b3b6-fb76f3d6d654 could not be found. May 23 12:41:19.555864 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:41:19.555864 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:41:19.555864 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:41:19.555864 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:41:19.555864 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:41:19.555864 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:41:19.555864 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:41:19.555864 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:41:19.555864 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:41:19.558167 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:41:19.558167 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:41:19.558167 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:41:19.558167 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:41:19.558167 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:41:19.558167 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:41:19.558167 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:41:19.558167 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40320b2c-6137-4266-b3b6-fb76f3d6d654 could not be found. May 23 12:41:19.558167 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:41:19.558167 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:41:19.558167 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:41:19.558167 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:41:19.558167 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:41:19.558167 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:41:19.558167 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:41:19.558167 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:41:19.558167 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40320b2c-6137-4266-b3b6-fb76f3d6d654 could not be found. May 23 12:41:19.558167 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:41:19.560629 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-3e8405ac-6a5c-4b67-a79b-a1242bdf8dc3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Returning 404 to user: Instance 40320b2c-6137-4266-b3b6-fb76f3d6d654 could not be found. {{(pid=124200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:41:19.560629 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-3e8405ac-6a5c-4b67-a79b-a1242bdf8dc3 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 404 len: 111 microversion: 2.20 time: 0.036738 May 23 12:41:19.560629 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 455/899] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:41:19 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 12:41:19.566792 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-140147ec-6355-4e61-b008-318c1015256b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '.version_select at 0x7f095d21d670>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:41:19.591843 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-140147ec-6355-4e61-b008-318c1015256b tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-365135125" status: 204 len: 0 microversion: 2.20 time: 0.028361 May 23 12:41:19.593011 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 445/900] 10.222.0.16 () {60 vars in 1258 bytes} [Mon May 23 12:41:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-365135125 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 23 12:41:21.993085 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-e41655b4-8ab4-41be-99b3-ae191a1c4c19 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:41:21.993769 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-e41655b4-8ab4-41be-99b3-ae191a1c4c19 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:41:22.003675 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e41655b4-8ab4-41be-99b3-ae191a1c4c19 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:22.004471 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e41655b4-8ab4-41be-99b3-ae191a1c4c19 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:22.005404 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e41655b4-8ab4-41be-99b3-ae191a1c4c19 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:22.005993 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e41655b4-8ab4-41be-99b3-ae191a1c4c19 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:22.021291 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.wsgi [None req-e41655b4-8ab4-41be-99b3-ae191a1c4c19 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] HTTP exception thrown: Instance 40320b2c-6137-4266-b3b6-fb76f3d6d654 could not be found. May 23 12:41:22.023600 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-e41655b4-8ab4-41be-99b3-ae191a1c4c19 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Request method failure captured: May 23 12:41:22.023600 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: request: DELETE /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 HTTP/1.1 May 23 12:41:22.023600 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept: application/json May 23 12:41:22.023600 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept-Encoding: identity May 23 12:41:22.023600 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Connection: close May 23 12:41:22.023600 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Length: 0 May 23 12:41:22.023600 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Type: application/json May 23 12:41:22.023600 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Host: 10.222.0.16 May 23 12:41:22.023600 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Openstack-System-Scope: None May 23 12:41:22.023600 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: User-Agent: python-urllib3/1.26.9 May 23 12:41:22.023600 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Auth-Token: gAAAAABii38UOn58rNAdiNYAPjH0omFFBsaNaO8_pzVIuQn4neM6lIxk4S5ERtpR-eO0Z7jfaS2HOB2FTPvEWVBv6qhuXlTO9wLieACj5bJof4If4yf5xtcblLcy8Aiwr6POOlbjhYtACwGg5Koy8rvnyA52MZqFVQGqLr0AWRd9UPIeyfBiuuU May 23 12:41:22.023600 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Id: None May 23 12:41:22.023600 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Name: None May 23 12:41:22.023600 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Identity-Status: Confirmed May 23 12:41:22.023600 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Is-Admin-Project: True May 23 12:41:22.023600 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Openstack-Nova-Api-Version: 2.20 May 23 12:41:22.023600 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Id: default May 23 12:41:22.023600 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Name: Default May 23 12:41:22.023600 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Id: 0502b9ef01e2460893cfc855d44db0c7 May 23 12:41:22.023600 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-457595946 May 23 12:41:22.023600 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Role: member,reader May 23 12:41:22.023600 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Roles: member,reader May 23 12:41:22.025298 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0502b9ef01e2460893cfc855d44db0c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0502b9ef01e2460893cfc855d44db0c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0502b9ef01e2460893cfc855d44db0c7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0502b9ef01e2460893cfc855d44db0c7"}]}] May 23 12:41:22.025298 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant: tempest-AttachVolumeShelveTestJSON-457595946 May 23 12:41:22.025298 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Id: 0502b9ef01e2460893cfc855d44db0c7 May 23 12:41:22.025298 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-457595946 May 23 12:41:22.025298 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User: tempest-AttachVolumeShelveTestJSON-457595946-project May 23 12:41:22.025298 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Id: default May 23 12:41:22.025298 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Name: Default May 23 12:41:22.025298 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Id: 851454212d14438d80bf8e193fea268e May 23 12:41:22.025298 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Name: tempest-AttachVolumeShelveTestJSON-457595946-project May 23 12:41:22.025298 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: method: > May 23 12:41:22.025298 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: exception: Instance 40320b2c-6137-4266-b3b6-fb76f3d6d654 could not be found. May 23 12:41:22.025298 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: action_args: {'id': '40320b2c-6137-4266-b3b6-fb76f3d6d654'} May 23 12:41:22.026053 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:41:22.026053 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:41:22.026053 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:41:22.026053 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:41:22.026053 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:41:22.026053 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:41:22.026053 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:41:22.026053 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:41:22.026053 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:41:22.026053 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:41:22.026053 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40320b2c-6137-4266-b3b6-fb76f3d6d654 could not be found. May 23 12:41:22.026053 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:41:22.026053 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:41:22.026053 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:41:22.026053 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:41:22.026053 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:41:22.026053 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:41:22.026053 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:41:22.026053 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:41:22.026053 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:41:22.028113 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:41:22.028113 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 12:41:22.028113 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 12:41:22.028113 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 12:41:22.028113 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 12:41:22.028113 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:41:22.028113 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:41:22.028113 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:41:22.028113 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:41:22.028113 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40320b2c-6137-4266-b3b6-fb76f3d6d654 could not be found. May 23 12:41:22.028113 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:41:22.028113 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:41:22.028113 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:41:22.028113 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:41:22.028113 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:41:22.028113 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:41:22.028113 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:41:22.028113 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:41:22.028113 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40320b2c-6137-4266-b3b6-fb76f3d6d654 could not be found. May 23 12:41:22.028113 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:41:22.032722 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-e41655b4-8ab4-41be-99b3-ae191a1c4c19 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Returning 404 to user: Instance 40320b2c-6137-4266-b3b6-fb76f3d6d654 could not be found. {{(pid=124200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:41:22.033789 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-e41655b4-8ab4-41be-99b3-ae191a1c4c19 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "DELETE /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 404 len: 111 microversion: 2.20 time: 0.046299 May 23 12:41:22.037843 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 456/901] 10.222.0.16 () {60 vars in 1279 bytes} [Mon May 23 12:41:21 2022] DELETE /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 12:41:22.047244 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-da379f4c-559b-4e03-b307-3c1edb816875 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:41:22.047882 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-da379f4c-559b-4e03-b307-3c1edb816875 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: 40320b2c-6137-4266-b3b6-fb76f3d6d654] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:41:22.064479 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-da379f4c-559b-4e03-b307-3c1edb816875 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:22.065557 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-da379f4c-559b-4e03-b307-3c1edb816875 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:22.066345 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-da379f4c-559b-4e03-b307-3c1edb816875 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:22.066783 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-da379f4c-559b-4e03-b307-3c1edb816875 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:22.098011 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.wsgi [None req-da379f4c-559b-4e03-b307-3c1edb816875 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] HTTP exception thrown: Instance 40320b2c-6137-4266-b3b6-fb76f3d6d654 could not be found. May 23 12:41:22.099727 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-da379f4c-559b-4e03-b307-3c1edb816875 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Request method failure captured: May 23 12:41:22.099727 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: request: GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 HTTP/1.1 May 23 12:41:22.099727 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept: application/json May 23 12:41:22.099727 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept-Encoding: identity May 23 12:41:22.099727 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Connection: close May 23 12:41:22.099727 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Length: 0 May 23 12:41:22.099727 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Type: application/json May 23 12:41:22.099727 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Host: 10.222.0.16 May 23 12:41:22.099727 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Openstack-System-Scope: None May 23 12:41:22.099727 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: User-Agent: python-urllib3/1.26.9 May 23 12:41:22.099727 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Auth-Token: gAAAAABii38UOn58rNAdiNYAPjH0omFFBsaNaO8_pzVIuQn4neM6lIxk4S5ERtpR-eO0Z7jfaS2HOB2FTPvEWVBv6qhuXlTO9wLieACj5bJof4If4yf5xtcblLcy8Aiwr6POOlbjhYtACwGg5Koy8rvnyA52MZqFVQGqLr0AWRd9UPIeyfBiuuU May 23 12:41:22.099727 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Id: None May 23 12:41:22.099727 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Name: None May 23 12:41:22.099727 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Identity-Status: Confirmed May 23 12:41:22.099727 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Is-Admin-Project: True May 23 12:41:22.099727 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Openstack-Nova-Api-Version: 2.20 May 23 12:41:22.099727 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Id: default May 23 12:41:22.099727 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Name: Default May 23 12:41:22.099727 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Id: 0502b9ef01e2460893cfc855d44db0c7 May 23 12:41:22.099727 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-457595946 May 23 12:41:22.099727 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Role: member,reader May 23 12:41:22.099727 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Roles: member,reader May 23 12:41:22.101982 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0502b9ef01e2460893cfc855d44db0c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0502b9ef01e2460893cfc855d44db0c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0502b9ef01e2460893cfc855d44db0c7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0502b9ef01e2460893cfc855d44db0c7"}]}] May 23 12:41:22.101982 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant: tempest-AttachVolumeShelveTestJSON-457595946 May 23 12:41:22.101982 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Id: 0502b9ef01e2460893cfc855d44db0c7 May 23 12:41:22.101982 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-457595946 May 23 12:41:22.101982 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User: tempest-AttachVolumeShelveTestJSON-457595946-project May 23 12:41:22.101982 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Id: default May 23 12:41:22.101982 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Name: Default May 23 12:41:22.101982 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Id: 851454212d14438d80bf8e193fea268e May 23 12:41:22.101982 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Name: tempest-AttachVolumeShelveTestJSON-457595946-project May 23 12:41:22.101982 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: method: > May 23 12:41:22.101982 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: exception: Instance 40320b2c-6137-4266-b3b6-fb76f3d6d654 could not be found. May 23 12:41:22.101982 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: action_args: {'id': '40320b2c-6137-4266-b3b6-fb76f3d6d654'} May 23 12:41:22.102816 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:41:22.102816 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:41:22.102816 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:41:22.102816 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:41:22.102816 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:41:22.102816 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:41:22.102816 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:41:22.102816 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:41:22.102816 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:41:22.102816 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:41:22.102816 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40320b2c-6137-4266-b3b6-fb76f3d6d654 could not be found. May 23 12:41:22.102816 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:41:22.102816 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:41:22.102816 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:41:22.102816 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:41:22.102816 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:41:22.102816 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:41:22.102816 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:41:22.102816 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:41:22.102816 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:41:22.104111 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:41:22.104111 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:41:22.104111 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:41:22.104111 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:41:22.104111 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:41:22.104111 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:41:22.104111 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:41:22.104111 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40320b2c-6137-4266-b3b6-fb76f3d6d654 could not be found. May 23 12:41:22.104111 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:41:22.104111 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:41:22.104111 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:41:22.104111 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:41:22.104111 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:41:22.104111 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:41:22.104111 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:41:22.104111 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:41:22.104111 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40320b2c-6137-4266-b3b6-fb76f3d6d654 could not be found. May 23 12:41:22.104111 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:41:22.105287 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-da379f4c-559b-4e03-b307-3c1edb816875 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Returning 404 to user: Instance 40320b2c-6137-4266-b3b6-fb76f3d6d654 could not be found. {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:41:22.105287 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-da379f4c-559b-4e03-b307-3c1edb816875 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654" status: 404 len: 111 microversion: 2.20 time: 0.058647 May 23 12:41:22.105287 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 446/902] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:41:22 2022] GET /compute/v2.1/servers/40320b2c-6137-4266-b3b6-fb76f3d6d654 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 12:41:23.316721 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-4fbe2763-9657-4a3f-adb5-e565d796ae4e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:41:23.317230 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-4fbe2763-9657-4a3f-adb5-e565d796ae4e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:41:23.330122 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4fbe2763-9657-4a3f-adb5-e565d796ae4e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:23.330567 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4fbe2763-9657-4a3f-adb5-e565d796ae4e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:23.331472 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4fbe2763-9657-4a3f-adb5-e565d796ae4e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:23.331774 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4fbe2763-9657-4a3f-adb5-e565d796ae4e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:23.354868 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.wsgi [None req-4fbe2763-9657-4a3f-adb5-e565d796ae4e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] HTTP exception thrown: Instance ce37af9c-e5f8-4233-97f3-4280a2114e45 could not be found. May 23 12:41:23.356531 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-4fbe2763-9657-4a3f-adb5-e565d796ae4e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Request method failure captured: May 23 12:41:23.356531 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: request: DELETE /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 HTTP/1.1 May 23 12:41:23.356531 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept: application/json May 23 12:41:23.356531 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept-Encoding: identity May 23 12:41:23.356531 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Connection: close May 23 12:41:23.356531 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Length: 0 May 23 12:41:23.356531 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Type: application/json May 23 12:41:23.356531 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Host: 10.222.0.16 May 23 12:41:23.356531 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Openstack-System-Scope: None May 23 12:41:23.356531 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: User-Agent: python-urllib3/1.26.9 May 23 12:41:23.356531 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Auth-Token: gAAAAABii38UOn58rNAdiNYAPjH0omFFBsaNaO8_pzVIuQn4neM6lIxk4S5ERtpR-eO0Z7jfaS2HOB2FTPvEWVBv6qhuXlTO9wLieACj5bJof4If4yf5xtcblLcy8Aiwr6POOlbjhYtACwGg5Koy8rvnyA52MZqFVQGqLr0AWRd9UPIeyfBiuuU May 23 12:41:23.356531 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Id: None May 23 12:41:23.356531 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Name: None May 23 12:41:23.356531 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Identity-Status: Confirmed May 23 12:41:23.356531 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Is-Admin-Project: True May 23 12:41:23.356531 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Openstack-Nova-Api-Version: 2.20 May 23 12:41:23.356531 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Id: default May 23 12:41:23.356531 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Name: Default May 23 12:41:23.356531 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Id: 0502b9ef01e2460893cfc855d44db0c7 May 23 12:41:23.356531 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-457595946 May 23 12:41:23.356531 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Role: member,reader May 23 12:41:23.356531 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Roles: member,reader May 23 12:41:23.358053 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0502b9ef01e2460893cfc855d44db0c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0502b9ef01e2460893cfc855d44db0c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0502b9ef01e2460893cfc855d44db0c7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0502b9ef01e2460893cfc855d44db0c7"}]}] May 23 12:41:23.358053 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant: tempest-AttachVolumeShelveTestJSON-457595946 May 23 12:41:23.358053 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Id: 0502b9ef01e2460893cfc855d44db0c7 May 23 12:41:23.358053 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-457595946 May 23 12:41:23.358053 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User: tempest-AttachVolumeShelveTestJSON-457595946-project May 23 12:41:23.358053 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Id: default May 23 12:41:23.358053 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Name: Default May 23 12:41:23.358053 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Id: 851454212d14438d80bf8e193fea268e May 23 12:41:23.358053 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Name: tempest-AttachVolumeShelveTestJSON-457595946-project May 23 12:41:23.358053 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: method: > May 23 12:41:23.358053 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: exception: Instance ce37af9c-e5f8-4233-97f3-4280a2114e45 could not be found. May 23 12:41:23.358053 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: action_args: {'id': 'ce37af9c-e5f8-4233-97f3-4280a2114e45'} May 23 12:41:23.362090 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:41:23.362090 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:41:23.362090 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:41:23.362090 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:41:23.362090 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:41:23.362090 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:41:23.362090 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:41:23.362090 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:41:23.362090 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:41:23.362090 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:41:23.362090 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce37af9c-e5f8-4233-97f3-4280a2114e45 could not be found. May 23 12:41:23.362090 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:41:23.362090 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:41:23.362090 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:41:23.362090 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:41:23.362090 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:41:23.362090 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:41:23.362090 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:41:23.362090 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:41:23.362090 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:41:23.363409 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:41:23.363409 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 12:41:23.363409 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 12:41:23.363409 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 12:41:23.363409 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 12:41:23.363409 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:41:23.363409 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:41:23.363409 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:41:23.363409 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:41:23.363409 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce37af9c-e5f8-4233-97f3-4280a2114e45 could not be found. May 23 12:41:23.363409 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:41:23.363409 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:41:23.363409 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:41:23.363409 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:41:23.363409 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:41:23.363409 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:41:23.363409 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:41:23.363409 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:41:23.363409 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce37af9c-e5f8-4233-97f3-4280a2114e45 could not be found. May 23 12:41:23.363409 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:41:23.366442 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-4fbe2763-9657-4a3f-adb5-e565d796ae4e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Returning 404 to user: Instance ce37af9c-e5f8-4233-97f3-4280a2114e45 could not be found. {{(pid=124200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:41:23.366442 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-4fbe2763-9657-4a3f-adb5-e565d796ae4e tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 404 len: 111 microversion: 2.20 time: 0.050448 May 23 12:41:23.366442 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 457/903] 10.222.0.16 () {60 vars in 1279 bytes} [Mon May 23 12:41:23 2022] DELETE /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 12:41:23.367937 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d515321d-f7fd-4957-9054-0a9e216eac57 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:41:23.368905 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d515321d-f7fd-4957-9054-0a9e216eac57 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] [instance: ce37af9c-e5f8-4233-97f3-4280a2114e45] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:41:23.375222 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d515321d-f7fd-4957-9054-0a9e216eac57 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:23.375671 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d515321d-f7fd-4957-9054-0a9e216eac57 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:23.376518 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d515321d-f7fd-4957-9054-0a9e216eac57 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:41:23.376956 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d515321d-f7fd-4957-9054-0a9e216eac57 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:41:23.403615 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.wsgi [None req-d515321d-f7fd-4957-9054-0a9e216eac57 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] HTTP exception thrown: Instance ce37af9c-e5f8-4233-97f3-4280a2114e45 could not be found. May 23 12:41:23.405254 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d515321d-f7fd-4957-9054-0a9e216eac57 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Request method failure captured: May 23 12:41:23.405254 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: request: GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 HTTP/1.1 May 23 12:41:23.405254 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept: application/json May 23 12:41:23.405254 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept-Encoding: identity May 23 12:41:23.405254 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Connection: close May 23 12:41:23.405254 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Length: 0 May 23 12:41:23.405254 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Type: application/json May 23 12:41:23.405254 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Host: 10.222.0.16 May 23 12:41:23.405254 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Openstack-System-Scope: None May 23 12:41:23.405254 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: User-Agent: python-urllib3/1.26.9 May 23 12:41:23.405254 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Auth-Token: gAAAAABii38UOn58rNAdiNYAPjH0omFFBsaNaO8_pzVIuQn4neM6lIxk4S5ERtpR-eO0Z7jfaS2HOB2FTPvEWVBv6qhuXlTO9wLieACj5bJof4If4yf5xtcblLcy8Aiwr6POOlbjhYtACwGg5Koy8rvnyA52MZqFVQGqLr0AWRd9UPIeyfBiuuU May 23 12:41:23.405254 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Id: None May 23 12:41:23.405254 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Name: None May 23 12:41:23.405254 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Identity-Status: Confirmed May 23 12:41:23.405254 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Is-Admin-Project: True May 23 12:41:23.405254 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Openstack-Nova-Api-Version: 2.20 May 23 12:41:23.405254 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Id: default May 23 12:41:23.405254 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Name: Default May 23 12:41:23.405254 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Id: 0502b9ef01e2460893cfc855d44db0c7 May 23 12:41:23.405254 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-457595946 May 23 12:41:23.405254 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Role: member,reader May 23 12:41:23.405254 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Roles: member,reader May 23 12:41:23.406962 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0502b9ef01e2460893cfc855d44db0c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0502b9ef01e2460893cfc855d44db0c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0502b9ef01e2460893cfc855d44db0c7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0502b9ef01e2460893cfc855d44db0c7"}]}] May 23 12:41:23.406962 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant: tempest-AttachVolumeShelveTestJSON-457595946 May 23 12:41:23.406962 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Id: 0502b9ef01e2460893cfc855d44db0c7 May 23 12:41:23.406962 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-457595946 May 23 12:41:23.406962 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User: tempest-AttachVolumeShelveTestJSON-457595946-project May 23 12:41:23.406962 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Id: default May 23 12:41:23.406962 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Name: Default May 23 12:41:23.406962 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Id: 851454212d14438d80bf8e193fea268e May 23 12:41:23.406962 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Name: tempest-AttachVolumeShelveTestJSON-457595946-project May 23 12:41:23.406962 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: method: > May 23 12:41:23.406962 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: exception: Instance ce37af9c-e5f8-4233-97f3-4280a2114e45 could not be found. May 23 12:41:23.406962 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: action_args: {'id': 'ce37af9c-e5f8-4233-97f3-4280a2114e45'} May 23 12:41:23.408967 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:41:23.408967 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:41:23.408967 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:41:23.408967 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:41:23.408967 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:41:23.408967 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:41:23.408967 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:41:23.408967 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:41:23.408967 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:41:23.408967 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:41:23.408967 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce37af9c-e5f8-4233-97f3-4280a2114e45 could not be found. May 23 12:41:23.408967 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:41:23.408967 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:41:23.408967 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:41:23.408967 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:41:23.408967 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:41:23.408967 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:41:23.408967 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:41:23.408967 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:41:23.408967 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:41:23.410410 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:41:23.410410 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:41:23.410410 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:41:23.410410 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:41:23.410410 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:41:23.410410 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:41:23.410410 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:41:23.410410 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce37af9c-e5f8-4233-97f3-4280a2114e45 could not be found. May 23 12:41:23.410410 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:41:23.410410 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:41:23.410410 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:41:23.410410 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:41:23.410410 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:41:23.410410 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:41:23.410410 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:41:23.410410 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:41:23.410410 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce37af9c-e5f8-4233-97f3-4280a2114e45 could not be found. May 23 12:41:23.410410 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:41:23.411709 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d515321d-f7fd-4957-9054-0a9e216eac57 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] Returning 404 to user: Instance ce37af9c-e5f8-4233-97f3-4280a2114e45 could not be found. {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:41:23.411709 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d515321d-f7fd-4957-9054-0a9e216eac57 tempest-AttachVolumeShelveTestJSON-457595946 tempest-AttachVolumeShelveTestJSON-457595946-project] 10.222.0.16 "GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45" status: 404 len: 111 microversion: 2.20 time: 0.043289 May 23 12:41:23.411709 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 447/904] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 12:41:23 2022] GET /compute/v2.1/servers/ce37af9c-e5f8-4233-97f3-4280a2114e45 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 12:41:30.875149 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-bdb7346b-221b-40c1-81c6-2267edb65cf3 tempest-VolumesNegativeTest-670976082 tempest-VolumesNegativeTest-670976082-project] Action: 'create', calling method: .version_select at 0x7f095caf3820>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2133578423", "metadata": {"Type": "work"}}} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:41:30.885415 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-bdb7346b-221b-40c1-81c6-2267edb65cf3 tempest-VolumesNegativeTest-670976082 tempest-VolumesNegativeTest-670976082-project] Request method failure captured: May 23 12:41:30.885415 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 23 12:41:30.885415 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept: application/json May 23 12:41:30.885415 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept-Encoding: identity May 23 12:41:30.885415 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Connection: close May 23 12:41:30.885415 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Length: 122 May 23 12:41:30.885415 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Type: application/json May 23 12:41:30.885415 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Host: 10.222.0.16 May 23 12:41:30.885415 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Openstack-System-Scope: None May 23 12:41:30.885415 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: User-Agent: python-urllib3/1.26.9 May 23 12:41:30.885415 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Auth-Token: gAAAAABii4D6_IcQCOxNXZbPtWE8T3J8WqmYRDDnLJmyVPvJzcoIkM5xy5Si5c_STV5ZKRiYEye2PvMJ3zJ3RS3YvCD014N6Qt1TTv3RU9uR9DEbyYPNBts5F0unMKHQJuZ8jlPqTYdSTNwKzXk0wt0GD8Vwn2wbhrEKlWMpkMIojkFw9ZJTpwk May 23 12:41:30.885415 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Id: None May 23 12:41:30.885415 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Name: None May 23 12:41:30.885415 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Identity-Status: Confirmed May 23 12:41:30.885415 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Is-Admin-Project: True May 23 12:41:30.885415 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Id: default May 23 12:41:30.885415 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Name: Default May 23 12:41:30.885415 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Id: d7480570ee8b45ac809e2a4aadf2b779 May 23 12:41:30.885415 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Name: tempest-VolumesNegativeTest-670976082 May 23 12:41:30.885415 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Role: member,reader May 23 12:41:30.885415 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Roles: member,reader May 23 12:41:30.887909 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d7480570ee8b45ac809e2a4aadf2b779"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d7480570ee8b45ac809e2a4aadf2b779"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d7480570ee8b45ac809e2a4aadf2b779", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d7480570ee8b45ac809e2a4aadf2b779"}]}] May 23 12:41:30.887909 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant: tempest-VolumesNegativeTest-670976082 May 23 12:41:30.887909 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Id: d7480570ee8b45ac809e2a4aadf2b779 May 23 12:41:30.887909 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Name: tempest-VolumesNegativeTest-670976082 May 23 12:41:30.887909 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User: tempest-VolumesNegativeTest-670976082-project May 23 12:41:30.887909 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Id: default May 23 12:41:30.887909 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Name: Default May 23 12:41:30.887909 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Id: ce434a6f39ed4d65bd026f4f6323f996 May 23 12:41:30.887909 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Name: tempest-VolumesNegativeTest-670976082-project May 23 12:41:30.887909 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: May 23 12:41:30.887909 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2133578423", "metadata": {"Type": "work"}}} May 23 12:41:30.887909 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: method: May 23 12:41:30.887909 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 23 12:41:30.889406 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2133578423', 'metadata': {'Type': 'work'}}}} May 23 12:41:30.889406 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:41:30.889406 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:41:30.889406 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 23 12:41:30.889406 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 23 12:41:30.889406 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 23 12:41:30.889406 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise error May 23 12:41:30.889406 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 23 12:41:30.889406 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:41:30.889406 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 23 12:41:30.889406 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 23 12:41:30.889406 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:41:30.889406 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi On instance['volume']: May 23 12:41:30.889406 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi '#$%' May 23 12:41:30.889406 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:41:30.889406 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:41:30.889406 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:41:30.889406 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:41:30.889406 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:41:30.889406 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:41:30.889406 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:41:30.889406 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:41:30.895130 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 12:41:30.895130 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 12:41:30.895130 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:41:30.895130 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:41:30.895130 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 23 12:41:30.895130 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 23 12:41:30.895130 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 23 12:41:30.895130 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 23 12:41:30.895130 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 23 12:41:30.895130 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 23 12:41:30.895130 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 23 12:41:30.895130 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:41:30.895130 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:41:30.895130 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:41:30.895130 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:41:30.895130 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:41:30.895130 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:41:30.895130 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 23 12:41:30.895130 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 23 12:41:30.899847 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 23 12:41:30.899847 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:41:30.899847 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-bdb7346b-221b-40c1-81c6-2267edb65cf3 tempest-VolumesNegativeTest-670976082 tempest-VolumesNegativeTest-670976082-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:41:30.899847 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-bdb7346b-221b-40c1-81c6-2267edb65cf3 tempest-VolumesNegativeTest-670976082 tempest-VolumesNegativeTest-670976082-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.199322 May 23 12:41:30.899847 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 458/905] 10.222.0.16 () {60 vars in 1155 bytes} [Mon May 23 12:41:30 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 202 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 12:41:30.914768 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-426d4c63-84f2-428e-8d9a-64ed62d0713c tempest-VolumesNegativeTest-670976082 tempest-VolumesNegativeTest-670976082-project] Action: 'create', calling method: .version_select at 0x7f095d21d9d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1050656340", "metadata": {"Type": "work"}}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:41:30.921005 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-426d4c63-84f2-428e-8d9a-64ed62d0713c tempest-VolumesNegativeTest-670976082 tempest-VolumesNegativeTest-670976082-project] Request method failure captured: May 23 12:41:30.921005 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 23 12:41:30.921005 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept: application/json May 23 12:41:30.921005 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept-Encoding: identity May 23 12:41:30.921005 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Connection: close May 23 12:41:30.921005 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Length: 120 May 23 12:41:30.921005 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Type: application/json May 23 12:41:30.921005 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Host: 10.222.0.16 May 23 12:41:30.921005 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Openstack-System-Scope: None May 23 12:41:30.921005 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: User-Agent: python-urllib3/1.26.9 May 23 12:41:30.921005 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Auth-Token: gAAAAABii4D6_IcQCOxNXZbPtWE8T3J8WqmYRDDnLJmyVPvJzcoIkM5xy5Si5c_STV5ZKRiYEye2PvMJ3zJ3RS3YvCD014N6Qt1TTv3RU9uR9DEbyYPNBts5F0unMKHQJuZ8jlPqTYdSTNwKzXk0wt0GD8Vwn2wbhrEKlWMpkMIojkFw9ZJTpwk May 23 12:41:30.921005 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Id: None May 23 12:41:30.921005 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Name: None May 23 12:41:30.921005 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Identity-Status: Confirmed May 23 12:41:30.921005 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Is-Admin-Project: True May 23 12:41:30.921005 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Id: default May 23 12:41:30.921005 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Name: Default May 23 12:41:30.921005 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Id: d7480570ee8b45ac809e2a4aadf2b779 May 23 12:41:30.921005 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Name: tempest-VolumesNegativeTest-670976082 May 23 12:41:30.921005 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Role: member,reader May 23 12:41:30.921005 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Roles: member,reader May 23 12:41:30.922614 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d7480570ee8b45ac809e2a4aadf2b779"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d7480570ee8b45ac809e2a4aadf2b779"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d7480570ee8b45ac809e2a4aadf2b779", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d7480570ee8b45ac809e2a4aadf2b779"}]}] May 23 12:41:30.922614 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant: tempest-VolumesNegativeTest-670976082 May 23 12:41:30.922614 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Id: d7480570ee8b45ac809e2a4aadf2b779 May 23 12:41:30.922614 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Name: tempest-VolumesNegativeTest-670976082 May 23 12:41:30.922614 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User: tempest-VolumesNegativeTest-670976082-project May 23 12:41:30.922614 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Id: default May 23 12:41:30.922614 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Name: Default May 23 12:41:30.922614 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Id: ce434a6f39ed4d65bd026f4f6323f996 May 23 12:41:30.922614 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Name: tempest-VolumesNegativeTest-670976082-project May 23 12:41:30.922614 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: May 23 12:41:30.922614 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1050656340", "metadata": {"Type": "work"}}} May 23 12:41:30.922614 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: method: May 23 12:41:30.922614 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 23 12:41:30.928552 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1050656340', 'metadata': {'Type': 'work'}}}} May 23 12:41:30.928552 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:41:30.928552 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:41:30.928552 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 23 12:41:30.928552 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 23 12:41:30.928552 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 23 12:41:30.928552 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise error May 23 12:41:30.928552 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 23 12:41:30.928552 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:41:30.928552 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 23 12:41:30.928552 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 23 12:41:30.928552 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:41:30.928552 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi On instance['volume']: May 23 12:41:30.928552 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi '0' May 23 12:41:30.928552 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:41:30.928552 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:41:30.928552 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:41:30.928552 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:41:30.928552 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:41:30.928552 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:41:30.928552 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:41:30.928552 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:41:30.930333 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 12:41:30.930333 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 12:41:30.930333 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:41:30.930333 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:41:30.930333 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 23 12:41:30.930333 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 23 12:41:30.930333 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 23 12:41:30.930333 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 23 12:41:30.930333 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 23 12:41:30.930333 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 23 12:41:30.930333 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 23 12:41:30.930333 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:41:30.930333 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:41:30.930333 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:41:30.930333 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:41:30.930333 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:41:30.930333 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:41:30.930333 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 23 12:41:30.930333 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 23 12:41:30.931784 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 23 12:41:30.931784 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:41:30.931784 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-426d4c63-84f2-428e-8d9a-64ed62d0713c tempest-VolumesNegativeTest-670976082 tempest-VolumesNegativeTest-670976082-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:41:30.931784 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-426d4c63-84f2-428e-8d9a-64ed62d0713c tempest-VolumesNegativeTest-670976082 tempest-VolumesNegativeTest-670976082-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.024604 May 23 12:41:30.931784 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 448/906] 10.222.0.16 () {60 vars in 1155 bytes} [Mon May 23 12:41:30 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 12:41:30.936345 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-f5cc4fb9-de85-46e0-bfba-515340bb0049 tempest-VolumesNegativeTest-670976082 tempest-VolumesNegativeTest-670976082-project] Action: 'create', calling method: .version_select at 0x7f095ca444c0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-382400931", "metadata": {"Type": "work"}}} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:41:30.943596 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-f5cc4fb9-de85-46e0-bfba-515340bb0049 tempest-VolumesNegativeTest-670976082 tempest-VolumesNegativeTest-670976082-project] Request method failure captured: May 23 12:41:30.943596 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 23 12:41:30.943596 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept: application/json May 23 12:41:30.943596 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept-Encoding: identity May 23 12:41:30.943596 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Connection: close May 23 12:41:30.943596 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Length: 118 May 23 12:41:30.943596 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Type: application/json May 23 12:41:30.943596 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Host: 10.222.0.16 May 23 12:41:30.943596 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Openstack-System-Scope: None May 23 12:41:30.943596 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: User-Agent: python-urllib3/1.26.9 May 23 12:41:30.943596 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Auth-Token: gAAAAABii4D6_IcQCOxNXZbPtWE8T3J8WqmYRDDnLJmyVPvJzcoIkM5xy5Si5c_STV5ZKRiYEye2PvMJ3zJ3RS3YvCD014N6Qt1TTv3RU9uR9DEbyYPNBts5F0unMKHQJuZ8jlPqTYdSTNwKzXk0wt0GD8Vwn2wbhrEKlWMpkMIojkFw9ZJTpwk May 23 12:41:30.943596 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Id: None May 23 12:41:30.943596 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Name: None May 23 12:41:30.943596 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Identity-Status: Confirmed May 23 12:41:30.943596 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Is-Admin-Project: True May 23 12:41:30.943596 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Id: default May 23 12:41:30.943596 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Name: Default May 23 12:41:30.943596 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Id: d7480570ee8b45ac809e2a4aadf2b779 May 23 12:41:30.943596 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Name: tempest-VolumesNegativeTest-670976082 May 23 12:41:30.943596 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Role: member,reader May 23 12:41:30.943596 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Roles: member,reader May 23 12:41:30.945539 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d7480570ee8b45ac809e2a4aadf2b779"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d7480570ee8b45ac809e2a4aadf2b779"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d7480570ee8b45ac809e2a4aadf2b779", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d7480570ee8b45ac809e2a4aadf2b779"}]}] May 23 12:41:30.945539 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant: tempest-VolumesNegativeTest-670976082 May 23 12:41:30.945539 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Id: d7480570ee8b45ac809e2a4aadf2b779 May 23 12:41:30.945539 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Name: tempest-VolumesNegativeTest-670976082 May 23 12:41:30.945539 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User: tempest-VolumesNegativeTest-670976082-project May 23 12:41:30.945539 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Id: default May 23 12:41:30.945539 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Name: Default May 23 12:41:30.945539 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Id: ce434a6f39ed4d65bd026f4f6323f996 May 23 12:41:30.945539 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Name: tempest-VolumesNegativeTest-670976082-project May 23 12:41:30.945539 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: May 23 12:41:30.945539 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-382400931", "metadata": {"Type": "work"}}} May 23 12:41:30.945539 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: method: May 23 12:41:30.945539 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 23 12:41:30.947957 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-382400931', 'metadata': {'Type': 'work'}}}} May 23 12:41:30.947957 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:41:30.947957 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:41:30.947957 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 23 12:41:30.947957 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 23 12:41:30.947957 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 23 12:41:30.947957 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise error May 23 12:41:30.947957 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 23 12:41:30.947957 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:41:30.947957 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 23 12:41:30.947957 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 23 12:41:30.947957 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:41:30.947957 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi On instance['volume']: May 23 12:41:30.947957 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi '' May 23 12:41:30.947957 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:41:30.947957 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:41:30.947957 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:41:30.947957 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:41:30.947957 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:41:30.947957 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:41:30.947957 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:41:30.947957 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:41:30.950571 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 12:41:30.950571 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 12:41:30.950571 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:41:30.950571 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:41:30.950571 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 23 12:41:30.950571 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 23 12:41:30.950571 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 23 12:41:30.950571 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 23 12:41:30.950571 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 23 12:41:30.950571 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 23 12:41:30.950571 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 23 12:41:30.950571 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:41:30.950571 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:41:30.950571 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:41:30.950571 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:41:30.950571 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:41:30.950571 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:41:30.950571 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 23 12:41:30.950571 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 23 12:41:30.951761 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 23 12:41:30.951761 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:41:30.951761 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-f5cc4fb9-de85-46e0-bfba-515340bb0049 tempest-VolumesNegativeTest-670976082 tempest-VolumesNegativeTest-670976082-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:41:30.951761 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-f5cc4fb9-de85-46e0-bfba-515340bb0049 tempest-VolumesNegativeTest-670976082 tempest-VolumesNegativeTest-670976082-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.015583 May 23 12:41:30.951761 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 459/907] 10.222.0.16 () {60 vars in 1155 bytes} [Mon May 23 12:41:30 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 12:41:30.959407 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-bf73f9e4-4a61-4c5c-a500-55b146261b34 tempest-VolumesNegativeTest-670976082 tempest-VolumesNegativeTest-670976082-project] Calling method '.version_select at 0x7f095d35c3a0>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:41:30.998450 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.wsgi [None req-bf73f9e4-4a61-4c5c-a500-55b146261b34 tempest-VolumesNegativeTest-670976082 tempest-VolumesNegativeTest-670976082-project] HTTP exception thrown: Volume tempest-invalid-1780669365 could not be found. May 23 12:41:31.002587 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-bf73f9e4-4a61-4c5c-a500-55b146261b34 tempest-VolumesNegativeTest-670976082 tempest-VolumesNegativeTest-670976082-project] Request method failure captured: May 23 12:41:31.002587 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1780669365 HTTP/1.1 May 23 12:41:31.002587 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept: application/json May 23 12:41:31.002587 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept-Encoding: identity May 23 12:41:31.002587 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Connection: close May 23 12:41:31.002587 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Length: 0 May 23 12:41:31.002587 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Type: application/json May 23 12:41:31.002587 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Host: 10.222.0.16 May 23 12:41:31.002587 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Openstack-System-Scope: None May 23 12:41:31.002587 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: User-Agent: python-urllib3/1.26.9 May 23 12:41:31.002587 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Auth-Token: gAAAAABii4D6_IcQCOxNXZbPtWE8T3J8WqmYRDDnLJmyVPvJzcoIkM5xy5Si5c_STV5ZKRiYEye2PvMJ3zJ3RS3YvCD014N6Qt1TTv3RU9uR9DEbyYPNBts5F0unMKHQJuZ8jlPqTYdSTNwKzXk0wt0GD8Vwn2wbhrEKlWMpkMIojkFw9ZJTpwk May 23 12:41:31.002587 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Id: None May 23 12:41:31.002587 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Name: None May 23 12:41:31.002587 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Identity-Status: Confirmed May 23 12:41:31.002587 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Is-Admin-Project: True May 23 12:41:31.002587 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Id: default May 23 12:41:31.002587 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Name: Default May 23 12:41:31.002587 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Id: d7480570ee8b45ac809e2a4aadf2b779 May 23 12:41:31.002587 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Name: tempest-VolumesNegativeTest-670976082 May 23 12:41:31.002587 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Role: member,reader May 23 12:41:31.002587 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Roles: member,reader May 23 12:41:31.003972 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d7480570ee8b45ac809e2a4aadf2b779"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d7480570ee8b45ac809e2a4aadf2b779"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d7480570ee8b45ac809e2a4aadf2b779", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d7480570ee8b45ac809e2a4aadf2b779"}]}] May 23 12:41:31.003972 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant: tempest-VolumesNegativeTest-670976082 May 23 12:41:31.003972 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Id: d7480570ee8b45ac809e2a4aadf2b779 May 23 12:41:31.003972 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Name: tempest-VolumesNegativeTest-670976082 May 23 12:41:31.003972 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User: tempest-VolumesNegativeTest-670976082-project May 23 12:41:31.003972 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Id: default May 23 12:41:31.003972 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Name: Default May 23 12:41:31.003972 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Id: ce434a6f39ed4d65bd026f4f6323f996 May 23 12:41:31.003972 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Name: tempest-VolumesNegativeTest-670976082-project May 23 12:41:31.003972 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: method: May 23 12:41:31.003972 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: exception: Volume tempest-invalid-1780669365 could not be found. May 23 12:41:31.003972 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: action_args: {'id': 'tempest-invalid-1780669365'} May 23 12:41:31.003972 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:41:31.006041 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:41:31.006041 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 12:41:31.006041 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 12:41:31.006041 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 12:41:31.006041 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 12:41:31.006041 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 12:41:31.006041 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 12:41:31.006041 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 12:41:31.006041 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 12:41:31.006041 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 12:41:31.006041 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 12:41:31.006041 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 12:41:31.006041 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 12:41:31.006041 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 12:41:31.006041 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 12:41:31.006041 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1780669365 could not be found. (HTTP 404) (Request-ID: req-cef247b1-f65b-45ce-a998-0295cff70725) May 23 12:41:31.006041 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:41:31.006041 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:41:31.006041 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:41:31.009690 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:41:31.009690 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 23 12:41:31.009690 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 23 12:41:31.009690 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 12:41:31.009690 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 12:41:31.009690 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 12:41:31.009690 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 12:41:31.009690 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 12:41:31.009690 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 12:41:31.009690 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 12:41:31.009690 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 12:41:31.009690 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 12:41:31.009690 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 12:41:31.009690 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 12:41:31.009690 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 12:41:31.009690 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 12:41:31.009690 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 12:41:31.009690 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 12:41:31.009690 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 12:41:31.010878 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 12:41:31.010878 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 12:41:31.010878 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 12:41:31.010878 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 12:41:31.010878 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1780669365 could not be found. May 23 12:41:31.010878 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:41:31.010878 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:41:31.010878 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:41:31.010878 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:41:31.010878 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:41:31.010878 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:41:31.010878 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:41:31.010878 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:41:31.010878 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 12:41:31.010878 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 12:41:31.010878 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:41:31.010878 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:41:31.010878 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 23 12:41:31.010878 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:41:31.010878 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1780669365 could not be found. May 23 12:41:31.012124 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:41:31.012124 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:41:31.012124 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:41:31.012124 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:41:31.012124 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:41:31.012124 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:41:31.012124 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:41:31.012124 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:41:31.012124 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1780669365 could not be found. May 23 12:41:31.012124 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:41:31.012124 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-bf73f9e4-4a61-4c5c-a500-55b146261b34 tempest-VolumesNegativeTest-670976082 tempest-VolumesNegativeTest-670976082-project] Returning 404 to user: Volume tempest-invalid-1780669365 could not be found. {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:41:31.012124 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-bf73f9e4-4a61-4c5c-a500-55b146261b34 tempest-VolumesNegativeTest-670976082 tempest-VolumesNegativeTest-670976082-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1780669365" status: 404 len: 99 microversion: 2.1 time: 0.050760 May 23 12:41:31.012124 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 449/908] 10.222.0.16 () {58 vars in 1217 bytes} [Mon May 23 12:41:30 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1780669365 => generated 99 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 23 12:41:31.016885 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-c20d3272-f797-46b0-b6cd-a755fdc02d46 tempest-VolumesNegativeTest-670976082 tempest-VolumesNegativeTest-670976082-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004037 May 23 12:41:31.021433 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 460/909] 10.222.0.16 () {58 vars in 1139 bytes} [Mon May 23 12:41:31 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 23 12:41:31.029201 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-56244a7f-e169-475d-887d-5ce27ae0a137 tempest-VolumesNegativeTest-670976082 tempest-VolumesNegativeTest-670976082-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004261 May 23 12:41:31.029803 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 450/910] 10.222.0.16 () {58 vars in 1136 bytes} [Mon May 23 12:41:31 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 23 12:41:31.043096 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-04abe856-3ae3-4ad9-bb22-3355b8aff0fb tempest-VolumesNegativeTest-670976082 tempest-VolumesNegativeTest-670976082-project] Calling method '.version_select at 0x7f095c88f700>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:41:31.074621 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.wsgi [None req-04abe856-3ae3-4ad9-bb22-3355b8aff0fb tempest-VolumesNegativeTest-670976082 tempest-VolumesNegativeTest-670976082-project] HTTP exception thrown: Volume 4afb8a43-b5f4-46ce-bb6b-744c3bed79f4 could not be found. May 23 12:41:31.076627 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-04abe856-3ae3-4ad9-bb22-3355b8aff0fb tempest-VolumesNegativeTest-670976082 tempest-VolumesNegativeTest-670976082-project] Request method failure captured: May 23 12:41:31.076627 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: request: DELETE /compute/v2.1/os-volumes/4afb8a43-b5f4-46ce-bb6b-744c3bed79f4 HTTP/1.1 May 23 12:41:31.076627 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept: application/json May 23 12:41:31.076627 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept-Encoding: identity May 23 12:41:31.076627 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Connection: close May 23 12:41:31.076627 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Length: 0 May 23 12:41:31.076627 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Type: application/json May 23 12:41:31.076627 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Host: 10.222.0.16 May 23 12:41:31.076627 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Openstack-System-Scope: None May 23 12:41:31.076627 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: User-Agent: python-urllib3/1.26.9 May 23 12:41:31.076627 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Auth-Token: gAAAAABii4D6_IcQCOxNXZbPtWE8T3J8WqmYRDDnLJmyVPvJzcoIkM5xy5Si5c_STV5ZKRiYEye2PvMJ3zJ3RS3YvCD014N6Qt1TTv3RU9uR9DEbyYPNBts5F0unMKHQJuZ8jlPqTYdSTNwKzXk0wt0GD8Vwn2wbhrEKlWMpkMIojkFw9ZJTpwk May 23 12:41:31.076627 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Id: None May 23 12:41:31.076627 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Name: None May 23 12:41:31.076627 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Identity-Status: Confirmed May 23 12:41:31.076627 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Is-Admin-Project: True May 23 12:41:31.076627 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Id: default May 23 12:41:31.076627 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Name: Default May 23 12:41:31.076627 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Id: d7480570ee8b45ac809e2a4aadf2b779 May 23 12:41:31.076627 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Name: tempest-VolumesNegativeTest-670976082 May 23 12:41:31.076627 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Role: member,reader May 23 12:41:31.076627 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Roles: member,reader May 23 12:41:31.082993 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d7480570ee8b45ac809e2a4aadf2b779"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d7480570ee8b45ac809e2a4aadf2b779"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d7480570ee8b45ac809e2a4aadf2b779", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d7480570ee8b45ac809e2a4aadf2b779"}]}] May 23 12:41:31.082993 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant: tempest-VolumesNegativeTest-670976082 May 23 12:41:31.082993 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Id: d7480570ee8b45ac809e2a4aadf2b779 May 23 12:41:31.082993 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Name: tempest-VolumesNegativeTest-670976082 May 23 12:41:31.082993 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User: tempest-VolumesNegativeTest-670976082-project May 23 12:41:31.082993 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Id: default May 23 12:41:31.082993 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Name: Default May 23 12:41:31.082993 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Id: ce434a6f39ed4d65bd026f4f6323f996 May 23 12:41:31.082993 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Name: tempest-VolumesNegativeTest-670976082-project May 23 12:41:31.082993 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: method: May 23 12:41:31.082993 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: exception: Volume 4afb8a43-b5f4-46ce-bb6b-744c3bed79f4 could not be found. May 23 12:41:31.082993 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: action_args: {'id': '4afb8a43-b5f4-46ce-bb6b-744c3bed79f4'} May 23 12:41:31.082993 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:41:31.084052 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:41:31.084052 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 12:41:31.084052 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 12:41:31.084052 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 12:41:31.084052 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 12:41:31.084052 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 12:41:31.084052 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 12:41:31.084052 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 12:41:31.084052 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 12:41:31.084052 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 12:41:31.084052 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 12:41:31.084052 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 12:41:31.084052 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 12:41:31.084052 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 12:41:31.084052 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 12:41:31.084052 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4afb8a43-b5f4-46ce-bb6b-744c3bed79f4 could not be found. (HTTP 404) (Request-ID: req-fded4a96-5cec-41c0-801d-bb404e285c74) May 23 12:41:31.084052 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:41:31.084052 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:41:31.084052 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:41:31.086099 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:41:31.086099 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 23 12:41:31.086099 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 23 12:41:31.086099 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 12:41:31.086099 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 12:41:31.086099 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 12:41:31.086099 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 12:41:31.086099 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 12:41:31.086099 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 12:41:31.086099 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 12:41:31.086099 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 12:41:31.086099 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 12:41:31.086099 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 12:41:31.086099 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 12:41:31.086099 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 12:41:31.086099 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 12:41:31.086099 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 12:41:31.086099 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 12:41:31.086099 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 12:41:31.088141 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 12:41:31.088141 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 12:41:31.088141 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 12:41:31.088141 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 12:41:31.088141 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4afb8a43-b5f4-46ce-bb6b-744c3bed79f4 could not be found. May 23 12:41:31.088141 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:41:31.088141 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:41:31.088141 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:41:31.088141 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:41:31.088141 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:41:31.088141 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:41:31.088141 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:41:31.088141 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:41:31.088141 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 12:41:31.088141 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 12:41:31.088141 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:41:31.088141 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:41:31.088141 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 23 12:41:31.088141 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:41:31.092041 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4afb8a43-b5f4-46ce-bb6b-744c3bed79f4 could not be found. May 23 12:41:31.092041 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:41:31.092041 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:41:31.092041 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:41:31.092041 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:41:31.092041 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:41:31.092041 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:41:31.092041 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:41:31.092041 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:41:31.092041 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4afb8a43-b5f4-46ce-bb6b-744c3bed79f4 could not be found. May 23 12:41:31.092041 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:41:31.092041 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-04abe856-3ae3-4ad9-bb22-3355b8aff0fb tempest-VolumesNegativeTest-670976082 tempest-VolumesNegativeTest-670976082-project] Returning 404 to user: Volume 4afb8a43-b5f4-46ce-bb6b-744c3bed79f4 could not be found. {{(pid=124200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:41:31.092041 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-04abe856-3ae3-4ad9-bb22-3355b8aff0fb tempest-VolumesNegativeTest-670976082 tempest-VolumesNegativeTest-670976082-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/4afb8a43-b5f4-46ce-bb6b-744c3bed79f4" status: 404 len: 109 microversion: 2.1 time: 0.040807 May 23 12:41:31.092041 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 461/911] 10.222.0.16 () {58 vars in 1247 bytes} [Mon May 23 12:41:31 2022] DELETE /compute/v2.1/os-volumes/4afb8a43-b5f4-46ce-bb6b-744c3bed79f4 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:41:31.094884 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-51b42b5d-8f38-4eb8-9476-d7c5a3601042 tempest-VolumesNegativeTest-670976082 tempest-VolumesNegativeTest-670976082-project] Calling method '.version_select at 0x7f095d53d310>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:41:31.132993 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.wsgi [None req-51b42b5d-8f38-4eb8-9476-d7c5a3601042 tempest-VolumesNegativeTest-670976082 tempest-VolumesNegativeTest-670976082-project] HTTP exception thrown: Volume ec2a8e3b-e277-4d49-a9f8-ec6518aed223 could not be found. May 23 12:41:31.135216 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-51b42b5d-8f38-4eb8-9476-d7c5a3601042 tempest-VolumesNegativeTest-670976082 tempest-VolumesNegativeTest-670976082-project] Request method failure captured: May 23 12:41:31.135216 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: request: GET /compute/v2.1/os-volumes/ec2a8e3b-e277-4d49-a9f8-ec6518aed223 HTTP/1.1 May 23 12:41:31.135216 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept: application/json May 23 12:41:31.135216 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept-Encoding: identity May 23 12:41:31.135216 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Connection: close May 23 12:41:31.135216 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Length: 0 May 23 12:41:31.135216 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Type: application/json May 23 12:41:31.135216 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Host: 10.222.0.16 May 23 12:41:31.135216 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Openstack-System-Scope: None May 23 12:41:31.135216 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: User-Agent: python-urllib3/1.26.9 May 23 12:41:31.135216 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Auth-Token: gAAAAABii4D6_IcQCOxNXZbPtWE8T3J8WqmYRDDnLJmyVPvJzcoIkM5xy5Si5c_STV5ZKRiYEye2PvMJ3zJ3RS3YvCD014N6Qt1TTv3RU9uR9DEbyYPNBts5F0unMKHQJuZ8jlPqTYdSTNwKzXk0wt0GD8Vwn2wbhrEKlWMpkMIojkFw9ZJTpwk May 23 12:41:31.135216 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Id: None May 23 12:41:31.135216 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Name: None May 23 12:41:31.135216 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Identity-Status: Confirmed May 23 12:41:31.135216 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Is-Admin-Project: True May 23 12:41:31.135216 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Id: default May 23 12:41:31.135216 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Name: Default May 23 12:41:31.135216 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Id: d7480570ee8b45ac809e2a4aadf2b779 May 23 12:41:31.135216 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Name: tempest-VolumesNegativeTest-670976082 May 23 12:41:31.135216 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Role: member,reader May 23 12:41:31.135216 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Roles: member,reader May 23 12:41:31.136677 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d7480570ee8b45ac809e2a4aadf2b779"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d7480570ee8b45ac809e2a4aadf2b779"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d7480570ee8b45ac809e2a4aadf2b779", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d7480570ee8b45ac809e2a4aadf2b779"}]}] May 23 12:41:31.136677 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant: tempest-VolumesNegativeTest-670976082 May 23 12:41:31.136677 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Id: d7480570ee8b45ac809e2a4aadf2b779 May 23 12:41:31.136677 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Name: tempest-VolumesNegativeTest-670976082 May 23 12:41:31.136677 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User: tempest-VolumesNegativeTest-670976082-project May 23 12:41:31.136677 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Id: default May 23 12:41:31.136677 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Name: Default May 23 12:41:31.136677 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Id: ce434a6f39ed4d65bd026f4f6323f996 May 23 12:41:31.136677 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Name: tempest-VolumesNegativeTest-670976082-project May 23 12:41:31.136677 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: method: May 23 12:41:31.136677 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: exception: Volume ec2a8e3b-e277-4d49-a9f8-ec6518aed223 could not be found. May 23 12:41:31.136677 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: action_args: {'id': 'ec2a8e3b-e277-4d49-a9f8-ec6518aed223'} May 23 12:41:31.136677 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:41:31.137515 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:41:31.137515 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 12:41:31.137515 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 12:41:31.137515 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 12:41:31.137515 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 12:41:31.137515 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 12:41:31.137515 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 12:41:31.137515 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 12:41:31.137515 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 12:41:31.137515 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 12:41:31.137515 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 12:41:31.137515 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 12:41:31.137515 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 12:41:31.137515 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 12:41:31.137515 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 12:41:31.137515 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ec2a8e3b-e277-4d49-a9f8-ec6518aed223 could not be found. (HTTP 404) (Request-ID: req-9e269843-3657-43b7-aa1a-7f8de15f9863) May 23 12:41:31.137515 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:41:31.137515 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:41:31.137515 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:41:31.138715 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:41:31.138715 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 23 12:41:31.138715 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 23 12:41:31.138715 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 12:41:31.138715 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 12:41:31.138715 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 12:41:31.138715 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 12:41:31.138715 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 12:41:31.138715 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 12:41:31.138715 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 12:41:31.138715 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 12:41:31.138715 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 12:41:31.138715 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 12:41:31.138715 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 12:41:31.138715 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 12:41:31.138715 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 12:41:31.138715 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 12:41:31.138715 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 12:41:31.138715 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 12:41:31.139881 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 12:41:31.139881 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 12:41:31.139881 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 12:41:31.139881 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 12:41:31.139881 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ec2a8e3b-e277-4d49-a9f8-ec6518aed223 could not be found. May 23 12:41:31.139881 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:41:31.139881 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:41:31.139881 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:41:31.139881 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:41:31.139881 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:41:31.139881 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:41:31.139881 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:41:31.139881 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:41:31.139881 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 12:41:31.139881 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 12:41:31.139881 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:41:31.139881 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:41:31.139881 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 23 12:41:31.139881 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:41:31.141088 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ec2a8e3b-e277-4d49-a9f8-ec6518aed223 could not be found. May 23 12:41:31.141088 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:41:31.141088 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:41:31.141088 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:41:31.141088 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:41:31.141088 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:41:31.141088 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:41:31.141088 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:41:31.141088 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:41:31.141088 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ec2a8e3b-e277-4d49-a9f8-ec6518aed223 could not be found. May 23 12:41:31.141088 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:41:31.141088 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-51b42b5d-8f38-4eb8-9476-d7c5a3601042 tempest-VolumesNegativeTest-670976082 tempest-VolumesNegativeTest-670976082-project] Returning 404 to user: Volume ec2a8e3b-e277-4d49-a9f8-ec6518aed223 could not be found. {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:41:31.141088 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-51b42b5d-8f38-4eb8-9476-d7c5a3601042 tempest-VolumesNegativeTest-670976082 tempest-VolumesNegativeTest-670976082-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/ec2a8e3b-e277-4d49-a9f8-ec6518aed223" status: 404 len: 109 microversion: 2.1 time: 0.052665 May 23 12:41:31.141088 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 451/912] 10.222.0.16 () {58 vars in 1244 bytes} [Mon May 23 12:41:31 2022] GET /compute/v2.1/os-volumes/ec2a8e3b-e277-4d49-a9f8-ec6518aed223 => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:42:02.540720 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 12:42:02.541974 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Mon May 23 12:42:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 12:42:03.735682 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_api:SELECT=19 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:42:03.736851 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell1:SELECT=43 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:42:03.740899 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-8b9f329f-f4e8-49da-8faa-9dc40dd4112d tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-495354734", "imageRef": "bb11dfa4-2977-4163-8237-78c871c8437f", "flavorRef": "452", "networks": [{"uuid": "90fb7855-0ef3-43be-b055-1437d271fdfa"}]}} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:42:03.798151 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.network.neutron [None req-8b9f329f-f4e8-49da-8faa-9dc40dd4112d tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] validate_networks() for [('90fb7855-0ef3-43be-b055-1437d271fdfa', None, None, None, None, None)] {{(pid=124200) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 12:42:04.203780 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-8b9f329f-f4e8-49da-8faa-9dc40dd4112d tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Flavor limits 0:0:0 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 12:42:04.204228 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-8b9f329f-f4e8-49da-8faa-9dc40dd4112d tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Image limits 0:0:0 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 12:42:04.204984 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-8b9f329f-f4e8-49da-8faa-9dc40dd4112d tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Flavor pref 0:0:0 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 12:42:04.205385 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-8b9f329f-f4e8-49da-8faa-9dc40dd4112d tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Image pref 0:0:0 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 12:42:04.205818 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-8b9f329f-f4e8-49da-8faa-9dc40dd4112d tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 12:42:04.215243 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8b9f329f-f4e8-49da-8faa-9dc40dd4112d tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:04.215686 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8b9f329f-f4e8-49da-8faa-9dc40dd4112d tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:04.216517 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8b9f329f-f4e8-49da-8faa-9dc40dd4112d tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:04.216945 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8b9f329f-f4e8-49da-8faa-9dc40dd4112d tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:04.233781 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.quota [None req-8b9f329f-f4e8-49da-8faa-9dc40dd4112d tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Getting quotas for project d05c15fec3294719b7f8bc5690f355f9. Resources: {'instances', 'cores', 'ram'} {{(pid=124200) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:42:04.237733 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.quota [None req-8b9f329f-f4e8-49da-8faa-9dc40dd4112d tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Getting quotas for user c7c4f8f2298d4014b2a08aaa391751f9 and project d05c15fec3294719b7f8bc5690f355f9. Resources: {'instances', 'cores', 'ram'} {{(pid=124200) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:42:04.249029 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-8b9f329f-f4e8-49da-8faa-9dc40dd4112d tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Going to run 1 instances... {{(pid=124200) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 12:42:04.251274 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-8b9f329f-f4e8-49da-8faa-9dc40dd4112d tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] [instance: 368f54cc-0400-4e69-bd8c-bc929f5ed639] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb11dfa4-2977-4163-8237-78c871c8437f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124200) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 12:42:04.299024 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-8b9f329f-f4e8-49da-8faa-9dc40dd4112d tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.564465 May 23 12:42:04.299845 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 462/913] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 23 12:42:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 23 12:42:04.307175 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:42:04.308555 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:42:04.312618 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-bbc39904-37f6-4ce0-9777-18f1a6282018 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:42:04.313233 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-bbc39904-37f6-4ce0-9777-18f1a6282018 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] [instance: 368f54cc-0400-4e69-bd8c-bc929f5ed639] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:42:04.373621 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-bbc39904-37f6-4ce0-9777-18f1a6282018 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c4f8f2298d4014b2a08aaa391751f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05c15fec3294719b7f8bc5690f355f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:42:04.380407 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-bbc39904-37f6-4ce0-9777-18f1a6282018 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] 10.222.0.16 "GET /compute/v2.1/servers/368f54cc-0400-4e69-bd8c-bc929f5ed639" status: 200 len: 1218 microversion: 2.1 time: 0.074594 May 23 12:42:04.380971 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 452/914] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:42:04 2022] GET /compute/v2.1/servers/368f54cc-0400-4e69-bd8c-bc929f5ed639 => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:42:05.398039 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-d87bf67a-cf03-4895-b285-82f70d43d346 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:42:05.398768 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-d87bf67a-cf03-4895-b285-82f70d43d346 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] [instance: 368f54cc-0400-4e69-bd8c-bc929f5ed639] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:42:05.405441 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d87bf67a-cf03-4895-b285-82f70d43d346 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:05.406138 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d87bf67a-cf03-4895-b285-82f70d43d346 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:05.406933 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d87bf67a-cf03-4895-b285-82f70d43d346 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:05.407376 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d87bf67a-cf03-4895-b285-82f70d43d346 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:05.498627 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-d87bf67a-cf03-4895-b285-82f70d43d346 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c4f8f2298d4014b2a08aaa391751f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05c15fec3294719b7f8bc5690f355f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:42:05.506134 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-d87bf67a-cf03-4895-b285-82f70d43d346 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] 10.222.0.16 "GET /compute/v2.1/servers/368f54cc-0400-4e69-bd8c-bc929f5ed639" status: 200 len: 1288 microversion: 2.1 time: 0.112815 May 23 12:42:05.506793 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 463/915] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:42:05 2022] GET /compute/v2.1/servers/368f54cc-0400-4e69-bd8c-bc929f5ed639 => generated 1288 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:42:06.523568 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-53a2a6e6-0647-4bd2-8af5-a462c7ae34b4 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:42:06.524494 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-53a2a6e6-0647-4bd2-8af5-a462c7ae34b4 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] [instance: 368f54cc-0400-4e69-bd8c-bc929f5ed639] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:42:06.531177 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-53a2a6e6-0647-4bd2-8af5-a462c7ae34b4 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:06.531630 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-53a2a6e6-0647-4bd2-8af5-a462c7ae34b4 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:06.532446 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-53a2a6e6-0647-4bd2-8af5-a462c7ae34b4 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:06.532905 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-53a2a6e6-0647-4bd2-8af5-a462c7ae34b4 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:06.728054 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-cd86bbcd-7ce7-49b3-bf96-6f57a74d11e4 req-3b3c8afb-3337-4323-a4c1-782dac7418d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "368f54cc-0400-4e69-bd8c-bc929f5ed639", "tag": "062903fa-c701-4836-be6e-8c3b7184591b"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:42:06.738589 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-cd86bbcd-7ce7-49b3-bf96-6f57a74d11e4 req-3b3c8afb-3337-4323-a4c1-782dac7418d5 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:06.739255 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-cd86bbcd-7ce7-49b3-bf96-6f57a74d11e4 req-3b3c8afb-3337-4323-a4c1-782dac7418d5 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:06.751819 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-53a2a6e6-0647-4bd2-8af5-a462c7ae34b4 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c4f8f2298d4014b2a08aaa391751f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05c15fec3294719b7f8bc5690f355f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:42:06.752206 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-cd86bbcd-7ce7-49b3-bf96-6f57a74d11e4 req-3b3c8afb-3337-4323-a4c1-782dac7418d5 service nova] Creating event network-changed:062903fa-c701-4836-be6e-8c3b7184591b for instance 368f54cc-0400-4e69-bd8c-bc929f5ed639 on hv-cinder-83699 May 23 12:42:06.757661 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-cd86bbcd-7ce7-49b3-bf96-6f57a74d11e4 req-3b3c8afb-3337-4323-a4c1-782dac7418d5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033551 May 23 12:42:06.758877 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 464/916] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:42:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:42:06.767496 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-53a2a6e6-0647-4bd2-8af5-a462c7ae34b4 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] 10.222.0.16 "GET /compute/v2.1/servers/368f54cc-0400-4e69-bd8c-bc929f5ed639" status: 200 len: 1318 microversion: 2.1 time: 0.246795 May 23 12:42:06.767496 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 453/917] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:42:06 2022] GET /compute/v2.1/servers/368f54cc-0400-4e69-bd8c-bc929f5ed639 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:42:07.784280 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-7d4ea8f5-50a3-4483-84c5-985fba5b5af4 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:42:07.784988 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-7d4ea8f5-50a3-4483-84c5-985fba5b5af4 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] [instance: 368f54cc-0400-4e69-bd8c-bc929f5ed639] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:42:07.793812 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7d4ea8f5-50a3-4483-84c5-985fba5b5af4 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:07.794396 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7d4ea8f5-50a3-4483-84c5-985fba5b5af4 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:07.795079 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7d4ea8f5-50a3-4483-84c5-985fba5b5af4 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:07.808322 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7d4ea8f5-50a3-4483-84c5-985fba5b5af4 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:07.975186 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-7d4ea8f5-50a3-4483-84c5-985fba5b5af4 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c4f8f2298d4014b2a08aaa391751f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05c15fec3294719b7f8bc5690f355f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:42:07.983434 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-7d4ea8f5-50a3-4483-84c5-985fba5b5af4 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] 10.222.0.16 "GET /compute/v2.1/servers/368f54cc-0400-4e69-bd8c-bc929f5ed639" status: 200 len: 1318 microversion: 2.1 time: 0.204007 May 23 12:42:07.984000 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 465/918] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:42:07 2022] GET /compute/v2.1/servers/368f54cc-0400-4e69-bd8c-bc929f5ed639 => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:42:09.001007 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-ead93cb6-a9fb-4fd7-8787-1d6684a11761 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:42:09.002215 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-ead93cb6-a9fb-4fd7-8787-1d6684a11761 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] [instance: 368f54cc-0400-4e69-bd8c-bc929f5ed639] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:42:09.008685 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ead93cb6-a9fb-4fd7-8787-1d6684a11761 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:09.009134 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ead93cb6-a9fb-4fd7-8787-1d6684a11761 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:09.010234 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ead93cb6-a9fb-4fd7-8787-1d6684a11761 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:09.010605 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ead93cb6-a9fb-4fd7-8787-1d6684a11761 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:09.250549 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-ead93cb6-a9fb-4fd7-8787-1d6684a11761 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c4f8f2298d4014b2a08aaa391751f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05c15fec3294719b7f8bc5690f355f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:42:09.258437 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-ead93cb6-a9fb-4fd7-8787-1d6684a11761 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] 10.222.0.16 "GET /compute/v2.1/servers/368f54cc-0400-4e69-bd8c-bc929f5ed639" status: 200 len: 1318 microversion: 2.1 time: 0.261336 May 23 12:42:09.259099 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 454/919] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:42:08 2022] GET /compute/v2.1/servers/368f54cc-0400-4e69-bd8c-bc929f5ed639 => generated 1318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:42:10.276849 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-8dafd777-4fcf-46d2-9105-aca87a455444 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:42:10.277467 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-8dafd777-4fcf-46d2-9105-aca87a455444 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] [instance: 368f54cc-0400-4e69-bd8c-bc929f5ed639] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:42:10.285372 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8dafd777-4fcf-46d2-9105-aca87a455444 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:10.285836 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8dafd777-4fcf-46d2-9105-aca87a455444 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:10.286782 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8dafd777-4fcf-46d2-9105-aca87a455444 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:10.287239 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8dafd777-4fcf-46d2-9105-aca87a455444 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:10.548125 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-8dafd777-4fcf-46d2-9105-aca87a455444 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c4f8f2298d4014b2a08aaa391751f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05c15fec3294719b7f8bc5690f355f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:42:10.557357 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-8dafd777-4fcf-46d2-9105-aca87a455444 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] 10.222.0.16 "GET /compute/v2.1/servers/368f54cc-0400-4e69-bd8c-bc929f5ed639" status: 200 len: 1318 microversion: 2.1 time: 0.285309 May 23 12:42:10.557890 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 466/920] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:42:10 2022] GET /compute/v2.1/servers/368f54cc-0400-4e69-bd8c-bc929f5ed639 => generated 1318 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:42:11.575195 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-cf6e2d23-d61c-4851-a730-8afe2ac62138 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:42:11.575963 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-cf6e2d23-d61c-4851-a730-8afe2ac62138 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] [instance: 368f54cc-0400-4e69-bd8c-bc929f5ed639] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:42:11.583390 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cf6e2d23-d61c-4851-a730-8afe2ac62138 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:11.584019 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cf6e2d23-d61c-4851-a730-8afe2ac62138 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:11.584834 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cf6e2d23-d61c-4851-a730-8afe2ac62138 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:11.585324 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cf6e2d23-d61c-4851-a730-8afe2ac62138 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:11.762805 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-cf6e2d23-d61c-4851-a730-8afe2ac62138 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c4f8f2298d4014b2a08aaa391751f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05c15fec3294719b7f8bc5690f355f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:42:11.773707 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-cf6e2d23-d61c-4851-a730-8afe2ac62138 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] 10.222.0.16 "GET /compute/v2.1/servers/368f54cc-0400-4e69-bd8c-bc929f5ed639" status: 200 len: 1318 microversion: 2.1 time: 0.200743 May 23 12:42:11.774316 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 455/921] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:42:11 2022] GET /compute/v2.1/servers/368f54cc-0400-4e69-bd8c-bc929f5ed639 => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:42:11.843295 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-b2ebd64f-7751-4f19-81ec-1cc39582753d req-9a2d0c16-129c-4dfe-b214-dbacc5eab030 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "368f54cc-0400-4e69-bd8c-bc929f5ed639", "name": "network-vif-plugged", "status": "completed", "tag": "062903fa-c701-4836-be6e-8c3b7184591b"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:42:11.860719 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-b2ebd64f-7751-4f19-81ec-1cc39582753d req-9a2d0c16-129c-4dfe-b214-dbacc5eab030 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:11.861562 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-b2ebd64f-7751-4f19-81ec-1cc39582753d req-9a2d0c16-129c-4dfe-b214-dbacc5eab030 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:11.878059 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-b2ebd64f-7751-4f19-81ec-1cc39582753d req-9a2d0c16-129c-4dfe-b214-dbacc5eab030 service nova] Creating event network-vif-plugged:062903fa-c701-4836-be6e-8c3b7184591b for instance 368f54cc-0400-4e69-bd8c-bc929f5ed639 on hv-cinder-83699 May 23 12:42:11.883061 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-b2ebd64f-7751-4f19-81ec-1cc39582753d req-9a2d0c16-129c-4dfe-b214-dbacc5eab030 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043839 May 23 12:42:11.884419 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 467/922] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:42:12.791798 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-6889f211-282f-4444-b1c5-901c51f6fe90 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:42:12.792688 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-6889f211-282f-4444-b1c5-901c51f6fe90 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] [instance: 368f54cc-0400-4e69-bd8c-bc929f5ed639] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:42:12.800709 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6889f211-282f-4444-b1c5-901c51f6fe90 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:12.801385 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6889f211-282f-4444-b1c5-901c51f6fe90 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:12.802826 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6889f211-282f-4444-b1c5-901c51f6fe90 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:12.803704 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6889f211-282f-4444-b1c5-901c51f6fe90 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:12.973276 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-6889f211-282f-4444-b1c5-901c51f6fe90 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c4f8f2298d4014b2a08aaa391751f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05c15fec3294719b7f8bc5690f355f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:42:12.981143 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-6889f211-282f-4444-b1c5-901c51f6fe90 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] 10.222.0.16 "GET /compute/v2.1/servers/368f54cc-0400-4e69-bd8c-bc929f5ed639" status: 200 len: 1318 microversion: 2.1 time: 0.193909 May 23 12:42:12.981722 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 456/923] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:42:12 2022] GET /compute/v2.1/servers/368f54cc-0400-4e69-bd8c-bc929f5ed639 => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:42:14.001154 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-90dccf64-0bcf-4c2c-ad1d-699202d2a6c0 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:42:14.002622 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-90dccf64-0bcf-4c2c-ad1d-699202d2a6c0 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] [instance: 368f54cc-0400-4e69-bd8c-bc929f5ed639] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:42:14.030378 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-90dccf64-0bcf-4c2c-ad1d-699202d2a6c0 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:14.033422 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-90dccf64-0bcf-4c2c-ad1d-699202d2a6c0 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:14.035185 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-90dccf64-0bcf-4c2c-ad1d-699202d2a6c0 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:14.036064 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-90dccf64-0bcf-4c2c-ad1d-699202d2a6c0 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:14.224761 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell0:SELECT=2 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:42:14.247706 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-90dccf64-0bcf-4c2c-ad1d-699202d2a6c0 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c4f8f2298d4014b2a08aaa391751f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05c15fec3294719b7f8bc5690f355f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:42:14.250232 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell0:SELECT=6 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:42:14.269582 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-90dccf64-0bcf-4c2c-ad1d-699202d2a6c0 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] 10.222.0.16 "GET /compute/v2.1/servers/368f54cc-0400-4e69-bd8c-bc929f5ed639" status: 200 len: 1508 microversion: 2.1 time: 0.274343 May 23 12:42:14.270241 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 468/924] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:42:13 2022] GET /compute/v2.1/servers/368f54cc-0400-4e69-bd8c-bc929f5ed639 => generated 1508 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:42:18.462909 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell0:SELECT=2 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:42:18.684785 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-cad9cb9d-8e61-4e63-ab98-f70cb5f4e9b7 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Action: 'create', calling method: .version_select at 0x7f095d358af0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-975896852", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJC8JMHa5vPvHq8u8R+3Z1W5Mn80ShQ4oQFNiDbCr8b4KmwA5gSWEluIXYKp1zXsAcyTknNEMftrV18F7vTMOQ+c1DsQzpodaOYCwwX/dEFcpKxQN0pvV2PDQvY5m+nyAg=="}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:42:18.702952 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-cad9cb9d-8e61-4e63-ab98-f70cb5f4e9b7 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Getting quotas for project ac5975413f5548c3881ec3c868295836. Resources: {'key_pairs'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:42:18.707099 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-cad9cb9d-8e61-4e63-ab98-f70cb5f4e9b7 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Getting quotas for user 024cf85a89d445ff854fede06d0f9244 and project ac5975413f5548c3881ec3c868295836. Resources: {'key_pairs'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:42:18.730965 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-cad9cb9d-8e61-4e63-ab98-f70cb5f4e9b7 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.273133 May 23 12:42:18.731645 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 457/925] 10.222.0.16 () {60 vars in 1158 bytes} [Mon May 23 12:42:18 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:42:31.838843 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-42359c79-566c-41f9-87c5-b3f422c498fd tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "635d2e86-77d4-40de-8f19-72fe1c224932", "device": "/dev/sdb"}} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:42:31.840549 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-42359c79-566c-41f9-87c5-b3f422c498fd tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] [instance: 368f54cc-0400-4e69-bd8c-bc929f5ed639] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:42:31.843742 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:42:31.844124 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell1:SELECT=30 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:42:31.850969 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-42359c79-566c-41f9-87c5-b3f422c498fd tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:31.851416 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-42359c79-566c-41f9-87c5-b3f422c498fd tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:31.852204 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-42359c79-566c-41f9-87c5-b3f422c498fd tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:31.852670 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-42359c79-566c-41f9-87c5-b3f422c498fd tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:32.111880 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-42359c79-566c-41f9-87c5-b3f422c498fd tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] 10.222.0.16 "POST /compute/v2.1/servers/368f54cc-0400-4e69-bd8c-bc929f5ed639/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277614 May 23 12:42:32.112539 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 469/926] 10.222.0.16 () {60 vars in 1322 bytes} [Mon May 23 12:42:31 2022] POST /compute/v2.1/servers/368f54cc-0400-4e69-bd8c-bc929f5ed639/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:42:38.587275 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell1:SELECT=24 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:42:38.588088 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell0:SELECT=4 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:42:38.588762 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=1 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:42:38.593096 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-cd3ba499-d6c5-4e75-beb8-048aecb37d8f tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1104833117", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-975896852", "security_groups": [{"name": "tempest-secgroup-smoke-1035934523"}], "block_device_mapping_v2": [{"uuid": "edf1264f-b5a5-4252-ab1c-19c8489f2935", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "12b22b49-c25e-4ae4-ac66-3d3f23b3684e"}]}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:42:38.721120 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.network.neutron [None req-cd3ba499-d6c5-4e75-beb8-048aecb37d8f tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] validate_networks() for [('12b22b49-c25e-4ae4-ac66-3d3f23b3684e', None, None, None, None, None)] {{(pid=124199) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 12:42:39.090575 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-cd3ba499-d6c5-4e75-beb8-048aecb37d8f tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Flavor limits 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 12:42:39.091003 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-cd3ba499-d6c5-4e75-beb8-048aecb37d8f tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Image limits 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 12:42:39.091507 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-cd3ba499-d6c5-4e75-beb8-048aecb37d8f tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Flavor pref 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 12:42:39.091913 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-cd3ba499-d6c5-4e75-beb8-048aecb37d8f tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Image pref 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 12:42:39.092374 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-cd3ba499-d6c5-4e75-beb8-048aecb37d8f tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 12:42:39.101618 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cd3ba499-d6c5-4e75-beb8-048aecb37d8f tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:39.102070 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cd3ba499-d6c5-4e75-beb8-048aecb37d8f tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:39.102866 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cd3ba499-d6c5-4e75-beb8-048aecb37d8f tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:39.103306 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cd3ba499-d6c5-4e75-beb8-048aecb37d8f tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:39.120050 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-cd3ba499-d6c5-4e75-beb8-048aecb37d8f tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Getting quotas for project ac5975413f5548c3881ec3c868295836. Resources: {'instances', 'cores', 'ram'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:42:39.125404 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-cd3ba499-d6c5-4e75-beb8-048aecb37d8f tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Getting quotas for user 024cf85a89d445ff854fede06d0f9244 and project ac5975413f5548c3881ec3c868295836. Resources: {'instances', 'cores', 'ram'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:42:39.182171 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-cd3ba499-d6c5-4e75-beb8-048aecb37d8f tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Going to run 1 instances... {{(pid=124199) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 12:42:39.184280 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-cd3ba499-d6c5-4e75-beb8-048aecb37d8f tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 0ec9234d-3bbf-4d1f-8780-5544e03fe111] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='edf1264f-b5a5-4252-ab1c-19c8489f2935',volume_size=None,volume_type=None)] {{(pid=124199) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 12:42:39.310758 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-cd3ba499-d6c5-4e75-beb8-048aecb37d8f tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.724722 May 23 12:42:39.312219 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 458/927] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 23 12:42:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 12:42:39.322344 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-8c4a76b3-b333-46d6-95aa-03fe81cb2311 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:42:39.323119 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-8c4a76b3-b333-46d6-95aa-03fe81cb2311 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 0ec9234d-3bbf-4d1f-8780-5544e03fe111] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:42:39.378299 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-8c4a76b3-b333-46d6-95aa-03fe81cb2311 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:42:39.385190 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-8c4a76b3-b333-46d6-95aa-03fe81cb2311 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111" status: 200 len: 1094 microversion: 2.1 time: 0.067078 May 23 12:42:39.385755 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 470/928] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:42:39 2022] GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:42:40.403510 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-a64f2e48-2042-4557-b8be-94d6528f5e7e tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:42:40.404119 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-a64f2e48-2042-4557-b8be-94d6528f5e7e tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 0ec9234d-3bbf-4d1f-8780-5544e03fe111] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:42:40.411600 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a64f2e48-2042-4557-b8be-94d6528f5e7e tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:40.412052 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a64f2e48-2042-4557-b8be-94d6528f5e7e tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:40.412865 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a64f2e48-2042-4557-b8be-94d6528f5e7e tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:40.413311 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a64f2e48-2042-4557-b8be-94d6528f5e7e tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:40.478167 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-a64f2e48-2042-4557-b8be-94d6528f5e7e tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:42:40.485627 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-a64f2e48-2042-4557-b8be-94d6528f5e7e tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111" status: 200 len: 1144 microversion: 2.1 time: 0.086567 May 23 12:42:40.486202 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 459/929] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:42:40 2022] GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111 => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:42:41.502542 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-caefd422-20c1-4b55-a341-35d29d82f573 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:42:41.503149 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-caefd422-20c1-4b55-a341-35d29d82f573 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 0ec9234d-3bbf-4d1f-8780-5544e03fe111] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:42:41.512598 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-caefd422-20c1-4b55-a341-35d29d82f573 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:41.513049 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-caefd422-20c1-4b55-a341-35d29d82f573 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:41.513822 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-caefd422-20c1-4b55-a341-35d29d82f573 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:41.514263 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-caefd422-20c1-4b55-a341-35d29d82f573 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:41.573857 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-caefd422-20c1-4b55-a341-35d29d82f573 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:42:41.582257 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-caefd422-20c1-4b55-a341-35d29d82f573 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111" status: 200 len: 1136 microversion: 2.1 time: 0.084118 May 23 12:42:41.582898 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 471/930] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:42:41 2022] GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111 => generated 1136 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:42:42.601055 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-11a37fc9-1238-4685-b06d-d40715b8544b tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:42:42.601694 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-11a37fc9-1238-4685-b06d-d40715b8544b tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 0ec9234d-3bbf-4d1f-8780-5544e03fe111] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:42:42.613062 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-11a37fc9-1238-4685-b06d-d40715b8544b tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:42.614624 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-11a37fc9-1238-4685-b06d-d40715b8544b tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:42.615738 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-11a37fc9-1238-4685-b06d-d40715b8544b tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:42.616379 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-11a37fc9-1238-4685-b06d-d40715b8544b tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:42.835623 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-11a37fc9-1238-4685-b06d-d40715b8544b tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:42:42.843900 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-11a37fc9-1238-4685-b06d-d40715b8544b tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111" status: 200 len: 1278 microversion: 2.1 time: 0.247991 May 23 12:42:42.854170 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 460/931] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:42:42 2022] GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111 => generated 1278 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:42:43.518363 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-f27547a8-11c7-4d33-a409-39a12236234c req-9c2f53ab-8949-4f67-8fa1-e1fcfd7f69e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ec9234d-3bbf-4d1f-8780-5544e03fe111", "tag": "05be8af3-225e-46ed-b701-da573a908453"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:42:43.527292 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-f27547a8-11c7-4d33-a409-39a12236234c req-9c2f53ab-8949-4f67-8fa1-e1fcfd7f69e7 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:43.527993 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-f27547a8-11c7-4d33-a409-39a12236234c req-9c2f53ab-8949-4f67-8fa1-e1fcfd7f69e7 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:43.541326 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-f27547a8-11c7-4d33-a409-39a12236234c req-9c2f53ab-8949-4f67-8fa1-e1fcfd7f69e7 service nova] Creating event network-changed:05be8af3-225e-46ed-b701-da573a908453 for instance 0ec9234d-3bbf-4d1f-8780-5544e03fe111 on hv-cinder-83699 May 23 12:42:43.547154 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-f27547a8-11c7-4d33-a409-39a12236234c req-9c2f53ab-8949-4f67-8fa1-e1fcfd7f69e7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032696 May 23 12:42:43.548139 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 472/932] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:42:43.862450 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-2c9af8d1-acce-4fc3-baa6-c4b0b6d034cb tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:42:43.863054 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-2c9af8d1-acce-4fc3-baa6-c4b0b6d034cb tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 0ec9234d-3bbf-4d1f-8780-5544e03fe111] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:42:43.869497 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2c9af8d1-acce-4fc3-baa6-c4b0b6d034cb tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:43.869940 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2c9af8d1-acce-4fc3-baa6-c4b0b6d034cb tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:43.870698 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2c9af8d1-acce-4fc3-baa6-c4b0b6d034cb tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:43.871129 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2c9af8d1-acce-4fc3-baa6-c4b0b6d034cb tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:44.002223 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-2c9af8d1-acce-4fc3-baa6-c4b0b6d034cb tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:42:44.009730 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-2c9af8d1-acce-4fc3-baa6-c4b0b6d034cb tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111" status: 200 len: 1266 microversion: 2.1 time: 0.152107 May 23 12:42:44.010245 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 461/933] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:42:43 2022] GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:42:45.027895 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-ee159bed-62af-4168-a499-bcaaee4e872a tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:42:45.028646 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-ee159bed-62af-4168-a499-bcaaee4e872a tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 0ec9234d-3bbf-4d1f-8780-5544e03fe111] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:42:45.035385 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ee159bed-62af-4168-a499-bcaaee4e872a tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:45.035827 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ee159bed-62af-4168-a499-bcaaee4e872a tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:45.036616 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ee159bed-62af-4168-a499-bcaaee4e872a tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:45.037104 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ee159bed-62af-4168-a499-bcaaee4e872a tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:45.191322 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-ee159bed-62af-4168-a499-bcaaee4e872a tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:42:45.198953 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-ee159bed-62af-4168-a499-bcaaee4e872a tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111" status: 200 len: 1266 microversion: 2.1 time: 0.175832 May 23 12:42:45.199519 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 473/934] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:42:45 2022] GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:42:46.216883 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-1838d8bb-a49d-4d50-ab2f-a2a552dc979d tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:42:46.217574 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-1838d8bb-a49d-4d50-ab2f-a2a552dc979d tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 0ec9234d-3bbf-4d1f-8780-5544e03fe111] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:42:46.224222 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1838d8bb-a49d-4d50-ab2f-a2a552dc979d tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:46.224631 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1838d8bb-a49d-4d50-ab2f-a2a552dc979d tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:46.225417 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1838d8bb-a49d-4d50-ab2f-a2a552dc979d tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:46.225861 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1838d8bb-a49d-4d50-ab2f-a2a552dc979d tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:46.435430 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1838d8bb-a49d-4d50-ab2f-a2a552dc979d tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:42:46.443903 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-1838d8bb-a49d-4d50-ab2f-a2a552dc979d tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111" status: 200 len: 1266 microversion: 2.1 time: 0.231588 May 23 12:42:46.444510 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 462/935] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:42:46 2022] GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111 => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:42:47.461388 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-c78c9dc1-7306-411f-aed4-19315f7136fb tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:42:47.462027 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-c78c9dc1-7306-411f-aed4-19315f7136fb tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 0ec9234d-3bbf-4d1f-8780-5544e03fe111] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:42:47.469140 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c78c9dc1-7306-411f-aed4-19315f7136fb tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:47.469581 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c78c9dc1-7306-411f-aed4-19315f7136fb tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:47.470349 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c78c9dc1-7306-411f-aed4-19315f7136fb tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:47.470786 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c78c9dc1-7306-411f-aed4-19315f7136fb tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:47.605538 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-c78c9dc1-7306-411f-aed4-19315f7136fb tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:42:47.613284 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-c78c9dc1-7306-411f-aed4-19315f7136fb tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111" status: 200 len: 1266 microversion: 2.1 time: 0.155751 May 23 12:42:47.613847 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 474/936] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:42:47 2022] GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:42:48.630042 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c2647f54-a779-4ecc-bd4b-9233d95620e4 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:42:48.630660 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c2647f54-a779-4ecc-bd4b-9233d95620e4 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 0ec9234d-3bbf-4d1f-8780-5544e03fe111] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:42:48.637266 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c2647f54-a779-4ecc-bd4b-9233d95620e4 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:48.637720 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c2647f54-a779-4ecc-bd4b-9233d95620e4 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:48.638487 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c2647f54-a779-4ecc-bd4b-9233d95620e4 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:48.638925 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c2647f54-a779-4ecc-bd4b-9233d95620e4 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:48.771998 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c2647f54-a779-4ecc-bd4b-9233d95620e4 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:42:48.779515 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c2647f54-a779-4ecc-bd4b-9233d95620e4 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111" status: 200 len: 1266 microversion: 2.1 time: 0.153336 May 23 12:42:48.780718 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 463/937] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:42:48 2022] GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:42:49.798838 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-0d1fc4e0-8e11-4ee2-bc73-b79e7d22bbfc tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:42:49.799453 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-0d1fc4e0-8e11-4ee2-bc73-b79e7d22bbfc tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 0ec9234d-3bbf-4d1f-8780-5544e03fe111] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:42:49.801861 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell0:SELECT=2 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:42:49.807414 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0d1fc4e0-8e11-4ee2-bc73-b79e7d22bbfc tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:49.807861 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0d1fc4e0-8e11-4ee2-bc73-b79e7d22bbfc tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:49.808661 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0d1fc4e0-8e11-4ee2-bc73-b79e7d22bbfc tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:49.809101 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0d1fc4e0-8e11-4ee2-bc73-b79e7d22bbfc tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:49.937059 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-0d1fc4e0-8e11-4ee2-bc73-b79e7d22bbfc tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:42:49.944432 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-0d1fc4e0-8e11-4ee2-bc73-b79e7d22bbfc tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111" status: 200 len: 1266 microversion: 2.1 time: 0.150299 May 23 12:42:49.944985 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 475/938] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:42:49 2022] GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:42:50.962078 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-21a27357-8c46-4771-97f3-be5218002469 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:42:50.962679 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-21a27357-8c46-4771-97f3-be5218002469 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 0ec9234d-3bbf-4d1f-8780-5544e03fe111] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:42:50.964555 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell0:SELECT=2 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:42:50.965369 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell0:SELECT=6 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:42:50.972195 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-21a27357-8c46-4771-97f3-be5218002469 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:50.972650 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-21a27357-8c46-4771-97f3-be5218002469 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:50.973417 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-21a27357-8c46-4771-97f3-be5218002469 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:50.973854 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-21a27357-8c46-4771-97f3-be5218002469 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:51.113289 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-21a27357-8c46-4771-97f3-be5218002469 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:42:51.120963 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-21a27357-8c46-4771-97f3-be5218002469 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111" status: 200 len: 1266 microversion: 2.1 time: 0.163105 May 23 12:42:51.121525 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 464/939] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:42:50 2022] GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:42:52.138148 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-994a781c-5228-4c58-9812-3e19685bfcb7 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:42:52.138763 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-994a781c-5228-4c58-9812-3e19685bfcb7 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 0ec9234d-3bbf-4d1f-8780-5544e03fe111] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:42:52.146176 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-994a781c-5228-4c58-9812-3e19685bfcb7 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:52.146627 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-994a781c-5228-4c58-9812-3e19685bfcb7 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:52.147395 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-994a781c-5228-4c58-9812-3e19685bfcb7 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:52.147832 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-994a781c-5228-4c58-9812-3e19685bfcb7 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:52.279314 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-994a781c-5228-4c58-9812-3e19685bfcb7 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:42:52.287418 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-994a781c-5228-4c58-9812-3e19685bfcb7 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111" status: 200 len: 1266 microversion: 2.1 time: 0.153228 May 23 12:42:52.287993 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 476/940] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:42:52 2022] GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:42:53.304303 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-57ef1dcd-0f7a-42fa-aa84-100be8fb74e5 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:42:53.304846 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-57ef1dcd-0f7a-42fa-aa84-100be8fb74e5 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 0ec9234d-3bbf-4d1f-8780-5544e03fe111] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:42:53.312051 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-57ef1dcd-0f7a-42fa-aa84-100be8fb74e5 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:53.312648 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-57ef1dcd-0f7a-42fa-aa84-100be8fb74e5 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:53.313415 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-57ef1dcd-0f7a-42fa-aa84-100be8fb74e5 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:53.313851 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-57ef1dcd-0f7a-42fa-aa84-100be8fb74e5 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:53.444138 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-57ef1dcd-0f7a-42fa-aa84-100be8fb74e5 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:42:53.451578 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-57ef1dcd-0f7a-42fa-aa84-100be8fb74e5 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111" status: 200 len: 1266 microversion: 2.1 time: 0.151198 May 23 12:42:53.452476 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 465/941] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:42:53 2022] GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:42:54.468543 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-c213d9fc-3c10-4eb6-8f99-facee9e4cf19 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:42:54.469314 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-c213d9fc-3c10-4eb6-8f99-facee9e4cf19 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 0ec9234d-3bbf-4d1f-8780-5544e03fe111] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:42:54.475777 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c213d9fc-3c10-4eb6-8f99-facee9e4cf19 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:54.476327 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c213d9fc-3c10-4eb6-8f99-facee9e4cf19 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:54.477095 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c213d9fc-3c10-4eb6-8f99-facee9e4cf19 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:54.477533 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c213d9fc-3c10-4eb6-8f99-facee9e4cf19 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:54.613654 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-c213d9fc-3c10-4eb6-8f99-facee9e4cf19 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:42:54.623070 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-c213d9fc-3c10-4eb6-8f99-facee9e4cf19 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111" status: 200 len: 1266 microversion: 2.1 time: 0.158114 May 23 12:42:54.623971 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 477/942] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:42:54 2022] GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:42:54.932875 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-41c7bd7e-f609-4444-bbfb-94240f7a3d2f tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:42:54.933382 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-41c7bd7e-f609-4444-bbfb-94240f7a3d2f tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] [instance: 368f54cc-0400-4e69-bd8c-bc929f5ed639] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:42:54.940666 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-41c7bd7e-f609-4444-bbfb-94240f7a3d2f tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:54.941120 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-41c7bd7e-f609-4444-bbfb-94240f7a3d2f tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:54.941894 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-41c7bd7e-f609-4444-bbfb-94240f7a3d2f tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:54.942338 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-41c7bd7e-f609-4444-bbfb-94240f7a3d2f tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:55.030591 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.objects.instance [None req-41c7bd7e-f609-4444-bbfb-94240f7a3d2f tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lazy-loading 'services' on Instance uuid 368f54cc-0400-4e69-bd8c-bc929f5ed639 {{(pid=124199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:42:55.104198 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-41c7bd7e-f609-4444-bbfb-94240f7a3d2f tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] 10.222.0.16 "DELETE /compute/v2.1/servers/368f54cc-0400-4e69-bd8c-bc929f5ed639/os-volume_attachments/635d2e86-77d4-40de-8f19-72fe1c224932" status: 202 len: 0 microversion: 2.1 time: 0.174982 May 23 12:42:55.104972 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 466/943] 10.222.0.16 () {58 vars in 1415 bytes} [Mon May 23 12:42:54 2022] DELETE /compute/v2.1/servers/368f54cc-0400-4e69-bd8c-bc929f5ed639/os-volume_attachments/635d2e86-77d4-40de-8f19-72fe1c224932 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:42:55.642380 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-3010ef11-07b4-4734-bc1b-193f1f58b030 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:42:55.643112 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-3010ef11-07b4-4734-bc1b-193f1f58b030 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 0ec9234d-3bbf-4d1f-8780-5544e03fe111] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:42:55.649791 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3010ef11-07b4-4734-bc1b-193f1f58b030 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:55.650258 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3010ef11-07b4-4734-bc1b-193f1f58b030 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:55.651038 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3010ef11-07b4-4734-bc1b-193f1f58b030 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:55.651480 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3010ef11-07b4-4734-bc1b-193f1f58b030 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:55.785757 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-3010ef11-07b4-4734-bc1b-193f1f58b030 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:42:55.793888 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-3010ef11-07b4-4734-bc1b-193f1f58b030 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111" status: 200 len: 1266 microversion: 2.1 time: 0.156250 May 23 12:42:55.794372 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 478/944] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:42:55 2022] GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:42:56.222470 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-09e74eee-eced-4f7c-b169-49bc9d195b61 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:42:56.223058 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-09e74eee-eced-4f7c-b169-49bc9d195b61 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] [instance: 368f54cc-0400-4e69-bd8c-bc929f5ed639] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:42:56.229850 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-09e74eee-eced-4f7c-b169-49bc9d195b61 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:56.230300 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-09e74eee-eced-4f7c-b169-49bc9d195b61 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:56.231064 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-09e74eee-eced-4f7c-b169-49bc9d195b61 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:56.231501 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-09e74eee-eced-4f7c-b169-49bc9d195b61 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:56.256190 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-09e74eee-eced-4f7c-b169-49bc9d195b61 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] [instance: 368f54cc-0400-4e69-bd8c-bc929f5ed639] Going to try to terminate instance {{(pid=124199) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 12:42:56.334095 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-09e74eee-eced-4f7c-b169-49bc9d195b61 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] 10.222.0.16 "DELETE /compute/v2.1/servers/368f54cc-0400-4e69-bd8c-bc929f5ed639" status: 204 len: 0 microversion: 2.1 time: 0.116073 May 23 12:42:56.334764 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 467/945] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 12:42:56 2022] DELETE /compute/v2.1/servers/368f54cc-0400-4e69-bd8c-bc929f5ed639 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 12:42:56.343183 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-0d9ccc75-94b7-4368-8c8f-33f088e282b2 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:42:56.343910 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-0d9ccc75-94b7-4368-8c8f-33f088e282b2 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] [instance: 368f54cc-0400-4e69-bd8c-bc929f5ed639] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:42:56.350911 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0d9ccc75-94b7-4368-8c8f-33f088e282b2 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:56.351362 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0d9ccc75-94b7-4368-8c8f-33f088e282b2 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:56.352132 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0d9ccc75-94b7-4368-8c8f-33f088e282b2 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:56.352592 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-0d9ccc75-94b7-4368-8c8f-33f088e282b2 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:56.483510 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-0d9ccc75-94b7-4368-8c8f-33f088e282b2 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c4f8f2298d4014b2a08aaa391751f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05c15fec3294719b7f8bc5690f355f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:42:56.491200 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-0d9ccc75-94b7-4368-8c8f-33f088e282b2 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] 10.222.0.16 "GET /compute/v2.1/servers/368f54cc-0400-4e69-bd8c-bc929f5ed639" status: 200 len: 1514 microversion: 2.1 time: 0.151914 May 23 12:42:56.491762 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 479/946] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:42:56 2022] GET /compute/v2.1/servers/368f54cc-0400-4e69-bd8c-bc929f5ed639 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:42:56.812116 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-6ec1b56f-0b9e-4950-9307-29f380c25d96 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:42:56.812883 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-6ec1b56f-0b9e-4950-9307-29f380c25d96 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 0ec9234d-3bbf-4d1f-8780-5544e03fe111] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:42:56.819669 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6ec1b56f-0b9e-4950-9307-29f380c25d96 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:56.820129 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6ec1b56f-0b9e-4950-9307-29f380c25d96 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:56.820898 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6ec1b56f-0b9e-4950-9307-29f380c25d96 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:56.821330 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6ec1b56f-0b9e-4950-9307-29f380c25d96 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:56.952628 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-6ec1b56f-0b9e-4950-9307-29f380c25d96 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:42:56.960578 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-6ec1b56f-0b9e-4950-9307-29f380c25d96 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111" status: 200 len: 1266 microversion: 2.1 time: 0.152682 May 23 12:42:56.961140 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 468/947] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:42:56 2022] GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:42:57.501333 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-6213f471-2947-4d82-94ec-28c82fd4c49f req-38335f50-5213-4105-a441-fbb2bb829018 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ec9234d-3bbf-4d1f-8780-5544e03fe111", "name": "network-vif-plugged", "status": "completed", "tag": "05be8af3-225e-46ed-b701-da573a908453"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:42:57.509409 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-67a2b136-a9eb-47b4-8a88-b540d84d2609 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:42:57.509981 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-6213f471-2947-4d82-94ec-28c82fd4c49f req-38335f50-5213-4105-a441-fbb2bb829018 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:57.510133 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-67a2b136-a9eb-47b4-8a88-b540d84d2609 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] [instance: 368f54cc-0400-4e69-bd8c-bc929f5ed639] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:42:57.510411 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-6213f471-2947-4d82-94ec-28c82fd4c49f req-38335f50-5213-4105-a441-fbb2bb829018 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:57.516890 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-67a2b136-a9eb-47b4-8a88-b540d84d2609 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:57.517378 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-67a2b136-a9eb-47b4-8a88-b540d84d2609 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:57.518175 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-67a2b136-a9eb-47b4-8a88-b540d84d2609 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:57.518612 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-67a2b136-a9eb-47b4-8a88-b540d84d2609 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:57.522371 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-6213f471-2947-4d82-94ec-28c82fd4c49f req-38335f50-5213-4105-a441-fbb2bb829018 service nova] Creating event network-vif-plugged:05be8af3-225e-46ed-b701-da573a908453 for instance 0ec9234d-3bbf-4d1f-8780-5544e03fe111 on hv-cinder-83699 May 23 12:42:57.527366 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-6213f471-2947-4d82-94ec-28c82fd4c49f req-38335f50-5213-4105-a441-fbb2bb829018 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029716 May 23 12:42:57.527956 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 480/948] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:42:57.663229 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-67a2b136-a9eb-47b4-8a88-b540d84d2609 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c4f8f2298d4014b2a08aaa391751f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05c15fec3294719b7f8bc5690f355f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:42:57.671638 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-67a2b136-a9eb-47b4-8a88-b540d84d2609 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] 10.222.0.16 "GET /compute/v2.1/servers/368f54cc-0400-4e69-bd8c-bc929f5ed639" status: 200 len: 1514 microversion: 2.1 time: 0.166363 May 23 12:42:57.672223 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 469/949] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:42:57 2022] GET /compute/v2.1/servers/368f54cc-0400-4e69-bd8c-bc929f5ed639 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:42:57.977943 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-e905ffeb-1e1e-4040-87af-c983c5dfe1eb tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:42:57.978661 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-e905ffeb-1e1e-4040-87af-c983c5dfe1eb tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 0ec9234d-3bbf-4d1f-8780-5544e03fe111] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:42:57.987629 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e905ffeb-1e1e-4040-87af-c983c5dfe1eb tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:57.988087 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e905ffeb-1e1e-4040-87af-c983c5dfe1eb tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:57.988901 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e905ffeb-1e1e-4040-87af-c983c5dfe1eb tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:57.989335 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e905ffeb-1e1e-4040-87af-c983c5dfe1eb tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:58.141159 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-e905ffeb-1e1e-4040-87af-c983c5dfe1eb tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:42:58.149100 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-e905ffeb-1e1e-4040-87af-c983c5dfe1eb tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111" status: 200 len: 1266 microversion: 2.1 time: 0.175383 May 23 12:42:58.149676 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 481/950] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:42:57 2022] GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:42:58.428599 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-2750fb92-d9b0-4bc1-bdd5-ee5c7315b8f8 req-552b21b5-3e32-48a8-86ba-61ea53b26a3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "368f54cc-0400-4e69-bd8c-bc929f5ed639", "name": "network-vif-deleted", "tag": "062903fa-c701-4836-be6e-8c3b7184591b"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:42:58.436645 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-2750fb92-d9b0-4bc1-bdd5-ee5c7315b8f8 req-552b21b5-3e32-48a8-86ba-61ea53b26a3e service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:58.437118 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-2750fb92-d9b0-4bc1-bdd5-ee5c7315b8f8 req-552b21b5-3e32-48a8-86ba-61ea53b26a3e service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:58.450246 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-2750fb92-d9b0-4bc1-bdd5-ee5c7315b8f8 req-552b21b5-3e32-48a8-86ba-61ea53b26a3e service nova] Creating event network-vif-deleted:062903fa-c701-4836-be6e-8c3b7184591b for instance 368f54cc-0400-4e69-bd8c-bc929f5ed639 on hv-cinder-83699 May 23 12:42:58.455783 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-2750fb92-d9b0-4bc1-bdd5-ee5c7315b8f8 req-552b21b5-3e32-48a8-86ba-61ea53b26a3e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030161 May 23 12:42:58.456386 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 470/951] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:42:58.689538 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-6a4f7de4-94ce-4509-90db-e6f41377191f tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:42:58.690127 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-6a4f7de4-94ce-4509-90db-e6f41377191f tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] [instance: 368f54cc-0400-4e69-bd8c-bc929f5ed639] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:42:58.697093 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6a4f7de4-94ce-4509-90db-e6f41377191f tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:58.697549 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6a4f7de4-94ce-4509-90db-e6f41377191f tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:58.698334 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6a4f7de4-94ce-4509-90db-e6f41377191f tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:58.698777 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6a4f7de4-94ce-4509-90db-e6f41377191f tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:59.052431 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-6a4f7de4-94ce-4509-90db-e6f41377191f tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c4f8f2298d4014b2a08aaa391751f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05c15fec3294719b7f8bc5690f355f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:42:59.059985 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-6a4f7de4-94ce-4509-90db-e6f41377191f tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] 10.222.0.16 "GET /compute/v2.1/servers/368f54cc-0400-4e69-bd8c-bc929f5ed639" status: 200 len: 1303 microversion: 2.1 time: 0.374524 May 23 12:42:59.060582 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 482/952] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:42:58 2022] GET /compute/v2.1/servers/368f54cc-0400-4e69-bd8c-bc929f5ed639 => generated 1303 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:42:59.167913 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-bb222429-90eb-4991-b17b-adf091980066 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:42:59.168679 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-bb222429-90eb-4991-b17b-adf091980066 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 0ec9234d-3bbf-4d1f-8780-5544e03fe111] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:42:59.176497 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bb222429-90eb-4991-b17b-adf091980066 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:59.176949 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bb222429-90eb-4991-b17b-adf091980066 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:59.178572 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bb222429-90eb-4991-b17b-adf091980066 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:59.179005 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bb222429-90eb-4991-b17b-adf091980066 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:59.308575 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-bb222429-90eb-4991-b17b-adf091980066 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:42:59.316255 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-bb222429-90eb-4991-b17b-adf091980066 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111" status: 200 len: 1454 microversion: 2.1 time: 0.153460 May 23 12:42:59.316822 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 471/953] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:42:59 2022] GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111 => generated 1454 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:42:59.332771 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-94d5cff8-da8f-42c3-8234-13ab245f5a78 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:42:59.333383 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-94d5cff8-da8f-42c3-8234-13ab245f5a78 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 0ec9234d-3bbf-4d1f-8780-5544e03fe111] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:42:59.339371 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-94d5cff8-da8f-42c3-8234-13ab245f5a78 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:59.339822 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-94d5cff8-da8f-42c3-8234-13ab245f5a78 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:59.340644 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-94d5cff8-da8f-42c3-8234-13ab245f5a78 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:42:59.341084 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-94d5cff8-da8f-42c3-8234-13ab245f5a78 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:42:59.477726 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-94d5cff8-da8f-42c3-8234-13ab245f5a78 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:42:59.487890 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-94d5cff8-da8f-42c3-8234-13ab245f5a78 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111" status: 200 len: 1454 microversion: 2.1 time: 0.159534 May 23 12:42:59.488788 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 483/954] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:42:59 2022] GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111 => generated 1454 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:43:00.076848 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-44506829-202d-4925-8f97-fa2664fd70e4 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:43:00.077560 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-44506829-202d-4925-8f97-fa2664fd70e4 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] [instance: 368f54cc-0400-4e69-bd8c-bc929f5ed639] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:43:00.084636 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-44506829-202d-4925-8f97-fa2664fd70e4 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:43:00.085168 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-44506829-202d-4925-8f97-fa2664fd70e4 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:43:00.086014 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-44506829-202d-4925-8f97-fa2664fd70e4 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:43:00.086541 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-44506829-202d-4925-8f97-fa2664fd70e4 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:43:00.101458 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.wsgi [None req-44506829-202d-4925-8f97-fa2664fd70e4 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] HTTP exception thrown: Instance 368f54cc-0400-4e69-bd8c-bc929f5ed639 could not be found. May 23 12:43:00.103107 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-44506829-202d-4925-8f97-fa2664fd70e4 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Request method failure captured: May 23 12:43:00.103107 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: request: GET /compute/v2.1/servers/368f54cc-0400-4e69-bd8c-bc929f5ed639 HTTP/1.1 May 23 12:43:00.103107 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept: application/json May 23 12:43:00.103107 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept-Encoding: identity May 23 12:43:00.103107 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Connection: close May 23 12:43:00.103107 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Length: 0 May 23 12:43:00.103107 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Type: application/json May 23 12:43:00.103107 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Host: 10.222.0.16 May 23 12:43:00.103107 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Openstack-System-Scope: None May 23 12:43:00.103107 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: User-Agent: python-urllib3/1.26.9 May 23 12:43:00.103107 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Auth-Token: gAAAAABii4Ea60jszWsxl0Pz92S1gepQykRt0BNkdzv-N_uJualWsRXOZtQB4T_SMnNteYlKcx15lFbTlhe1ap_VFVYriN6Exm9Ep8Rwe_ISzg4MsHlzLRr91kDo1i9Ia4qKuJc6arfLTJHmYwbiWZhvzF-2A-uluxCW1wlpxNfq78Eiw6AFrUI May 23 12:43:00.103107 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Id: None May 23 12:43:00.103107 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Name: None May 23 12:43:00.103107 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Identity-Status: Confirmed May 23 12:43:00.103107 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Is-Admin-Project: True May 23 12:43:00.103107 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Id: default May 23 12:43:00.103107 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Name: Default May 23 12:43:00.103107 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Id: d05c15fec3294719b7f8bc5690f355f9 May 23 12:43:00.103107 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Name: tempest-VolumesSnapshotTestJSON-478383476 May 23 12:43:00.103107 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Role: member,reader May 23 12:43:00.103107 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Roles: member,reader May 23 12:43:00.104822 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d05c15fec3294719b7f8bc5690f355f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d05c15fec3294719b7f8bc5690f355f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d05c15fec3294719b7f8bc5690f355f9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d05c15fec3294719b7f8bc5690f355f9"}]}] May 23 12:43:00.104822 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant: tempest-VolumesSnapshotTestJSON-478383476 May 23 12:43:00.104822 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Id: d05c15fec3294719b7f8bc5690f355f9 May 23 12:43:00.104822 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-478383476 May 23 12:43:00.104822 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User: tempest-VolumesSnapshotTestJSON-478383476-project May 23 12:43:00.104822 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Id: default May 23 12:43:00.104822 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Name: Default May 23 12:43:00.104822 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Id: c7c4f8f2298d4014b2a08aaa391751f9 May 23 12:43:00.104822 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Name: tempest-VolumesSnapshotTestJSON-478383476-project May 23 12:43:00.104822 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: method: > May 23 12:43:00.104822 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: exception: Instance 368f54cc-0400-4e69-bd8c-bc929f5ed639 could not be found. May 23 12:43:00.104822 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: action_args: {'id': '368f54cc-0400-4e69-bd8c-bc929f5ed639'} May 23 12:43:00.105848 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:43:00.105848 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:43:00.105848 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:43:00.105848 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:43:00.105848 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:43:00.105848 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:43:00.105848 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:43:00.105848 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:43:00.105848 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:43:00.105848 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:43:00.105848 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 368f54cc-0400-4e69-bd8c-bc929f5ed639 could not be found. May 23 12:43:00.105848 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:43:00.105848 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:43:00.105848 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:43:00.105848 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:43:00.105848 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:43:00.105848 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:43:00.105848 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:43:00.105848 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:43:00.105848 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:43:00.107450 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:43:00.107450 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:43:00.107450 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:43:00.107450 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:43:00.107450 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:43:00.107450 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:43:00.107450 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:43:00.107450 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 368f54cc-0400-4e69-bd8c-bc929f5ed639 could not be found. May 23 12:43:00.107450 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:43:00.107450 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:43:00.107450 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:43:00.107450 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:43:00.107450 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:43:00.107450 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:43:00.107450 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:43:00.107450 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:43:00.107450 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 368f54cc-0400-4e69-bd8c-bc929f5ed639 could not be found. May 23 12:43:00.107450 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:43:00.108776 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-44506829-202d-4925-8f97-fa2664fd70e4 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Returning 404 to user: Instance 368f54cc-0400-4e69-bd8c-bc929f5ed639 could not be found. {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:43:00.108776 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-44506829-202d-4925-8f97-fa2664fd70e4 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] 10.222.0.16 "GET /compute/v2.1/servers/368f54cc-0400-4e69-bd8c-bc929f5ed639" status: 404 len: 111 microversion: 2.1 time: 0.031950 May 23 12:43:00.108776 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 472/955] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:43:00 2022] GET /compute/v2.1/servers/368f54cc-0400-4e69-bd8c-bc929f5ed639 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:43:01.211718 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-f8a9d2e5-4045-4d79-8fb4-743b67c8a12a req-93c25f3a-f90a-427a-bf75-6cdebe8446ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ec9234d-3bbf-4d1f-8780-5544e03fe111", "tag": "05be8af3-225e-46ed-b701-da573a908453"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:43:01.220668 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-f8a9d2e5-4045-4d79-8fb4-743b67c8a12a req-93c25f3a-f90a-427a-bf75-6cdebe8446ec service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:43:01.221153 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-f8a9d2e5-4045-4d79-8fb4-743b67c8a12a req-93c25f3a-f90a-427a-bf75-6cdebe8446ec service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:43:01.232482 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-f8a9d2e5-4045-4d79-8fb4-743b67c8a12a req-93c25f3a-f90a-427a-bf75-6cdebe8446ec service nova] Creating event network-changed:05be8af3-225e-46ed-b701-da573a908453 for instance 0ec9234d-3bbf-4d1f-8780-5544e03fe111 on hv-cinder-83699 May 23 12:43:01.238772 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-f8a9d2e5-4045-4d79-8fb4-743b67c8a12a req-93c25f3a-f90a-427a-bf75-6cdebe8446ec service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030591 May 23 12:43:01.239383 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 484/956] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:43:07.924044 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-15e681ac-416a-4e74-aa54-d4f97f1bf95b tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-525942402", "imageRef": "bb11dfa4-2977-4163-8237-78c871c8437f", "flavorRef": "452", "networks": [{"uuid": "90fb7855-0ef3-43be-b055-1437d271fdfa"}]}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:43:08.086126 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.network.neutron [None req-15e681ac-416a-4e74-aa54-d4f97f1bf95b tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] validate_networks() for [('90fb7855-0ef3-43be-b055-1437d271fdfa', None, None, None, None, None)] {{(pid=124199) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 12:43:08.426692 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-15e681ac-416a-4e74-aa54-d4f97f1bf95b tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Flavor limits 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 12:43:08.427105 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-15e681ac-416a-4e74-aa54-d4f97f1bf95b tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Image limits 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 12:43:08.427574 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-15e681ac-416a-4e74-aa54-d4f97f1bf95b tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Flavor pref 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 12:43:08.427975 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-15e681ac-416a-4e74-aa54-d4f97f1bf95b tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Image pref 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 12:43:08.428419 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-15e681ac-416a-4e74-aa54-d4f97f1bf95b tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 12:43:08.437204 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-15e681ac-416a-4e74-aa54-d4f97f1bf95b tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:43:08.437649 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-15e681ac-416a-4e74-aa54-d4f97f1bf95b tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:43:08.438442 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-15e681ac-416a-4e74-aa54-d4f97f1bf95b tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:43:08.438871 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-15e681ac-416a-4e74-aa54-d4f97f1bf95b tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:43:08.457324 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-15e681ac-416a-4e74-aa54-d4f97f1bf95b tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Getting quotas for project d05c15fec3294719b7f8bc5690f355f9. Resources: {'instances', 'cores', 'ram'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:43:08.461327 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-15e681ac-416a-4e74-aa54-d4f97f1bf95b tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Getting quotas for user c7c4f8f2298d4014b2a08aaa391751f9 and project d05c15fec3294719b7f8bc5690f355f9. Resources: {'instances', 'cores', 'ram'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:43:08.472679 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-15e681ac-416a-4e74-aa54-d4f97f1bf95b tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Going to run 1 instances... {{(pid=124199) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 12:43:08.474928 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-15e681ac-416a-4e74-aa54-d4f97f1bf95b tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] [instance: d248123c-9c79-4d05-8d4c-b76c00ff08f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb11dfa4-2977-4163-8237-78c871c8437f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124199) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 12:43:08.521854 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-15e681ac-416a-4e74-aa54-d4f97f1bf95b tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.601827 May 23 12:43:08.527811 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 473/957] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 23 12:43:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 12:43:08.535351 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-57612659-8aca-4fb6-b48d-cde8474891e1 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:43:08.536205 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-57612659-8aca-4fb6-b48d-cde8474891e1 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] [instance: d248123c-9c79-4d05-8d4c-b76c00ff08f3] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:43:08.544095 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_api:SELECT=35 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:43:08.660895 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-57612659-8aca-4fb6-b48d-cde8474891e1 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c4f8f2298d4014b2a08aaa391751f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05c15fec3294719b7f8bc5690f355f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:43:08.668752 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-57612659-8aca-4fb6-b48d-cde8474891e1 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] 10.222.0.16 "GET /compute/v2.1/servers/d248123c-9c79-4d05-8d4c-b76c00ff08f3" status: 200 len: 1218 microversion: 2.1 time: 0.139426 May 23 12:43:08.669354 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 485/958] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:43:08 2022] GET /compute/v2.1/servers/d248123c-9c79-4d05-8d4c-b76c00ff08f3 => generated 1218 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:43:09.688537 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-7d5caeda-457c-41e4-b2a5-7122197806cb tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:43:09.689165 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-7d5caeda-457c-41e4-b2a5-7122197806cb tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] [instance: d248123c-9c79-4d05-8d4c-b76c00ff08f3] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:43:09.691522 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:43:09.697037 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7d5caeda-457c-41e4-b2a5-7122197806cb tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:43:09.697494 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7d5caeda-457c-41e4-b2a5-7122197806cb tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:43:09.698276 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7d5caeda-457c-41e4-b2a5-7122197806cb tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:43:09.698720 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7d5caeda-457c-41e4-b2a5-7122197806cb tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:43:09.703512 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:43:09.763940 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-7d5caeda-457c-41e4-b2a5-7122197806cb tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c4f8f2298d4014b2a08aaa391751f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05c15fec3294719b7f8bc5690f355f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:43:09.772125 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-7d5caeda-457c-41e4-b2a5-7122197806cb tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] 10.222.0.16 "GET /compute/v2.1/servers/d248123c-9c79-4d05-8d4c-b76c00ff08f3" status: 200 len: 1276 microversion: 2.1 time: 0.088638 May 23 12:43:09.772720 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 474/959] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:43:09 2022] GET /compute/v2.1/servers/d248123c-9c79-4d05-8d4c-b76c00ff08f3 => generated 1276 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:43:10.789719 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-d59b7af5-d228-4a8e-adc4-9ccaac0ff479 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:43:10.790546 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-d59b7af5-d228-4a8e-adc4-9ccaac0ff479 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] [instance: d248123c-9c79-4d05-8d4c-b76c00ff08f3] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:43:10.797667 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d59b7af5-d228-4a8e-adc4-9ccaac0ff479 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:43:10.798195 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d59b7af5-d228-4a8e-adc4-9ccaac0ff479 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:43:10.798998 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d59b7af5-d228-4a8e-adc4-9ccaac0ff479 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:43:10.799442 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d59b7af5-d228-4a8e-adc4-9ccaac0ff479 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:43:10.805529 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:43:10.937763 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-d59b7af5-d228-4a8e-adc4-9ccaac0ff479 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c4f8f2298d4014b2a08aaa391751f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05c15fec3294719b7f8bc5690f355f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:43:10.945491 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-d59b7af5-d228-4a8e-adc4-9ccaac0ff479 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] 10.222.0.16 "GET /compute/v2.1/servers/d248123c-9c79-4d05-8d4c-b76c00ff08f3" status: 200 len: 1318 microversion: 2.1 time: 0.159526 May 23 12:43:10.946064 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 486/960] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:43:10 2022] GET /compute/v2.1/servers/d248123c-9c79-4d05-8d4c-b76c00ff08f3 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:43:10.972343 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-b24b4063-645d-46fc-9415-7eebe9c3e965 req-b0626ab0-f713-43ff-bf71-e3f13cb06db6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d248123c-9c79-4d05-8d4c-b76c00ff08f3", "tag": "5792b05e-3aab-4acc-bdc2-54ef03b163f0"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:43:10.982268 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-b24b4063-645d-46fc-9415-7eebe9c3e965 req-b0626ab0-f713-43ff-bf71-e3f13cb06db6 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:43:10.988079 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-b24b4063-645d-46fc-9415-7eebe9c3e965 req-b0626ab0-f713-43ff-bf71-e3f13cb06db6 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:43:11.000066 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-b24b4063-645d-46fc-9415-7eebe9c3e965 req-b0626ab0-f713-43ff-bf71-e3f13cb06db6 service nova] Creating event network-changed:5792b05e-3aab-4acc-bdc2-54ef03b163f0 for instance d248123c-9c79-4d05-8d4c-b76c00ff08f3 on hv-cinder-83699 May 23 12:43:11.004972 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-b24b4063-645d-46fc-9415-7eebe9c3e965 req-b0626ab0-f713-43ff-bf71-e3f13cb06db6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037069 May 23 12:43:11.005580 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 475/961] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:43:11.962446 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-1f750871-1b6f-45a0-87ae-8a421fa6240b tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:43:11.963083 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-1f750871-1b6f-45a0-87ae-8a421fa6240b tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] [instance: d248123c-9c79-4d05-8d4c-b76c00ff08f3] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:43:11.969643 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1f750871-1b6f-45a0-87ae-8a421fa6240b tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:43:11.970085 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1f750871-1b6f-45a0-87ae-8a421fa6240b tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:43:11.970913 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1f750871-1b6f-45a0-87ae-8a421fa6240b tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:43:11.971399 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1f750871-1b6f-45a0-87ae-8a421fa6240b tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:43:12.103643 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-1f750871-1b6f-45a0-87ae-8a421fa6240b tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c4f8f2298d4014b2a08aaa391751f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05c15fec3294719b7f8bc5690f355f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:43:12.111164 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-1f750871-1b6f-45a0-87ae-8a421fa6240b tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] 10.222.0.16 "GET /compute/v2.1/servers/d248123c-9c79-4d05-8d4c-b76c00ff08f3" status: 200 len: 1318 microversion: 2.1 time: 0.152602 May 23 12:43:12.112635 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 487/962] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:43:11 2022] GET /compute/v2.1/servers/d248123c-9c79-4d05-8d4c-b76c00ff08f3 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:43:13.130584 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-48b53a78-5419-4de3-ba22-1378ed551055 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:43:13.131313 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-48b53a78-5419-4de3-ba22-1378ed551055 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] [instance: d248123c-9c79-4d05-8d4c-b76c00ff08f3] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:43:13.137835 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-48b53a78-5419-4de3-ba22-1378ed551055 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:43:13.138289 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-48b53a78-5419-4de3-ba22-1378ed551055 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:43:13.139072 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-48b53a78-5419-4de3-ba22-1378ed551055 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:43:13.139508 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-48b53a78-5419-4de3-ba22-1378ed551055 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:43:13.269235 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-48b53a78-5419-4de3-ba22-1378ed551055 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c4f8f2298d4014b2a08aaa391751f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05c15fec3294719b7f8bc5690f355f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:43:13.279803 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-48b53a78-5419-4de3-ba22-1378ed551055 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] 10.222.0.16 "GET /compute/v2.1/servers/d248123c-9c79-4d05-8d4c-b76c00ff08f3" status: 200 len: 1318 microversion: 2.1 time: 0.154370 May 23 12:43:13.280338 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 476/963] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:43:13 2022] GET /compute/v2.1/servers/d248123c-9c79-4d05-8d4c-b76c00ff08f3 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:43:14.296384 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-5f195c37-3b0d-43bf-af08-1590623229e5 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:43:14.296960 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-5f195c37-3b0d-43bf-af08-1590623229e5 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] [instance: d248123c-9c79-4d05-8d4c-b76c00ff08f3] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:43:14.303960 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5f195c37-3b0d-43bf-af08-1590623229e5 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:43:14.304446 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5f195c37-3b0d-43bf-af08-1590623229e5 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:43:14.305212 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5f195c37-3b0d-43bf-af08-1590623229e5 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:43:14.305641 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5f195c37-3b0d-43bf-af08-1590623229e5 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:43:14.439107 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-5f195c37-3b0d-43bf-af08-1590623229e5 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c4f8f2298d4014b2a08aaa391751f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05c15fec3294719b7f8bc5690f355f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:43:14.451225 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-5f195c37-3b0d-43bf-af08-1590623229e5 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] 10.222.0.16 "GET /compute/v2.1/servers/d248123c-9c79-4d05-8d4c-b76c00ff08f3" status: 200 len: 1318 microversion: 2.1 time: 0.158797 May 23 12:43:14.451813 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 488/964] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:43:14 2022] GET /compute/v2.1/servers/d248123c-9c79-4d05-8d4c-b76c00ff08f3 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:43:15.469578 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-22ae2a3a-2ad3-4526-9634-df563a8683f4 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:43:15.470192 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-22ae2a3a-2ad3-4526-9634-df563a8683f4 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] [instance: d248123c-9c79-4d05-8d4c-b76c00ff08f3] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:43:15.477294 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-22ae2a3a-2ad3-4526-9634-df563a8683f4 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:43:15.477742 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-22ae2a3a-2ad3-4526-9634-df563a8683f4 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:43:15.478522 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-22ae2a3a-2ad3-4526-9634-df563a8683f4 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:43:15.478961 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-22ae2a3a-2ad3-4526-9634-df563a8683f4 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:43:15.611826 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-22ae2a3a-2ad3-4526-9634-df563a8683f4 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c4f8f2298d4014b2a08aaa391751f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05c15fec3294719b7f8bc5690f355f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:43:15.620335 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-22ae2a3a-2ad3-4526-9634-df563a8683f4 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] 10.222.0.16 "GET /compute/v2.1/servers/d248123c-9c79-4d05-8d4c-b76c00ff08f3" status: 200 len: 1318 microversion: 2.1 time: 0.154639 May 23 12:43:15.620921 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 477/965] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:43:15 2022] GET /compute/v2.1/servers/d248123c-9c79-4d05-8d4c-b76c00ff08f3 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:43:16.637444 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-4abf3d9e-7fa4-43b0-b3aa-e80c683d97c6 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:43:16.638086 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-4abf3d9e-7fa4-43b0-b3aa-e80c683d97c6 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] [instance: d248123c-9c79-4d05-8d4c-b76c00ff08f3] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:43:16.644603 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4abf3d9e-7fa4-43b0-b3aa-e80c683d97c6 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:43:16.645051 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4abf3d9e-7fa4-43b0-b3aa-e80c683d97c6 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:43:16.645824 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4abf3d9e-7fa4-43b0-b3aa-e80c683d97c6 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:43:16.646260 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4abf3d9e-7fa4-43b0-b3aa-e80c683d97c6 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:43:16.774349 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-4abf3d9e-7fa4-43b0-b3aa-e80c683d97c6 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c4f8f2298d4014b2a08aaa391751f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05c15fec3294719b7f8bc5690f355f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:43:16.781700 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-4abf3d9e-7fa4-43b0-b3aa-e80c683d97c6 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] 10.222.0.16 "GET /compute/v2.1/servers/d248123c-9c79-4d05-8d4c-b76c00ff08f3" status: 200 len: 1318 microversion: 2.1 time: 0.148158 May 23 12:43:16.782261 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 489/966] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:43:16 2022] GET /compute/v2.1/servers/d248123c-9c79-4d05-8d4c-b76c00ff08f3 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:43:17.640426 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-f047c1e2-38b7-4627-88e4-bb36849aac85 req-759ae146-5ff5-454c-8478-0e73793dab18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d248123c-9c79-4d05-8d4c-b76c00ff08f3", "name": "network-vif-plugged", "status": "completed", "tag": "5792b05e-3aab-4acc-bdc2-54ef03b163f0"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:43:17.651043 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-f047c1e2-38b7-4627-88e4-bb36849aac85 req-759ae146-5ff5-454c-8478-0e73793dab18 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:43:17.651495 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-f047c1e2-38b7-4627-88e4-bb36849aac85 req-759ae146-5ff5-454c-8478-0e73793dab18 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:43:17.665487 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-f047c1e2-38b7-4627-88e4-bb36849aac85 req-759ae146-5ff5-454c-8478-0e73793dab18 service nova] Creating event network-vif-plugged:5792b05e-3aab-4acc-bdc2-54ef03b163f0 for instance d248123c-9c79-4d05-8d4c-b76c00ff08f3 on hv-cinder-83699 May 23 12:43:17.670500 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-f047c1e2-38b7-4627-88e4-bb36849aac85 req-759ae146-5ff5-454c-8478-0e73793dab18 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033814 May 23 12:43:17.671098 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 478/967] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:43:17.799166 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-921b5341-924c-4529-ad0e-36f4902a2e2d tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:43:17.799696 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-921b5341-924c-4529-ad0e-36f4902a2e2d tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] [instance: d248123c-9c79-4d05-8d4c-b76c00ff08f3] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:43:17.806895 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-921b5341-924c-4529-ad0e-36f4902a2e2d tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:43:17.807345 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-921b5341-924c-4529-ad0e-36f4902a2e2d tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:43:17.808126 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-921b5341-924c-4529-ad0e-36f4902a2e2d tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:43:17.808593 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-921b5341-924c-4529-ad0e-36f4902a2e2d tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:43:17.943705 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-921b5341-924c-4529-ad0e-36f4902a2e2d tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c4f8f2298d4014b2a08aaa391751f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05c15fec3294719b7f8bc5690f355f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:43:17.951099 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-921b5341-924c-4529-ad0e-36f4902a2e2d tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] 10.222.0.16 "GET /compute/v2.1/servers/d248123c-9c79-4d05-8d4c-b76c00ff08f3" status: 200 len: 1318 microversion: 2.1 time: 0.155983 May 23 12:43:17.951651 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 490/968] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:43:17 2022] GET /compute/v2.1/servers/d248123c-9c79-4d05-8d4c-b76c00ff08f3 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:43:18.965729 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell0:SELECT=2 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:43:18.966485 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell0:SELECT=6 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:43:18.971345 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-2767a6d2-1f4c-46c0-90f4-706de08f24f7 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:43:18.972350 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-2767a6d2-1f4c-46c0-90f4-706de08f24f7 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] [instance: d248123c-9c79-4d05-8d4c-b76c00ff08f3] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:43:18.979344 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2767a6d2-1f4c-46c0-90f4-706de08f24f7 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:43:18.979789 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2767a6d2-1f4c-46c0-90f4-706de08f24f7 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:43:18.980570 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2767a6d2-1f4c-46c0-90f4-706de08f24f7 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:43:18.981006 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2767a6d2-1f4c-46c0-90f4-706de08f24f7 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:43:19.116084 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-2767a6d2-1f4c-46c0-90f4-706de08f24f7 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c4f8f2298d4014b2a08aaa391751f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05c15fec3294719b7f8bc5690f355f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:43:19.123649 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-2767a6d2-1f4c-46c0-90f4-706de08f24f7 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] 10.222.0.16 "GET /compute/v2.1/servers/d248123c-9c79-4d05-8d4c-b76c00ff08f3" status: 200 len: 1318 microversion: 2.1 time: 0.158816 May 23 12:43:19.124153 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 479/969] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:43:18 2022] GET /compute/v2.1/servers/d248123c-9c79-4d05-8d4c-b76c00ff08f3 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:43:20.139980 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-3d6b366b-2cd1-4c32-bfd8-be983c9a18e5 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:43:20.140640 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-3d6b366b-2cd1-4c32-bfd8-be983c9a18e5 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] [instance: d248123c-9c79-4d05-8d4c-b76c00ff08f3] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:43:20.142529 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell0:SELECT=2 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:43:20.148898 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3d6b366b-2cd1-4c32-bfd8-be983c9a18e5 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:43:20.149409 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3d6b366b-2cd1-4c32-bfd8-be983c9a18e5 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:43:20.150184 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3d6b366b-2cd1-4c32-bfd8-be983c9a18e5 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:43:20.150625 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3d6b366b-2cd1-4c32-bfd8-be983c9a18e5 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:43:20.281591 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-3d6b366b-2cd1-4c32-bfd8-be983c9a18e5 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c4f8f2298d4014b2a08aaa391751f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05c15fec3294719b7f8bc5690f355f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:43:20.289798 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-3d6b366b-2cd1-4c32-bfd8-be983c9a18e5 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] 10.222.0.16 "GET /compute/v2.1/servers/d248123c-9c79-4d05-8d4c-b76c00ff08f3" status: 200 len: 1508 microversion: 2.1 time: 0.153731 May 23 12:43:20.290361 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 491/970] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:43:20 2022] GET /compute/v2.1/servers/d248123c-9c79-4d05-8d4c-b76c00ff08f3 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:43:20.306513 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f62e5426-9c73-4d0a-b53f-6f0dbb32b9e8 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "58ff88c1-c62b-42c6-9028-125926c64fdf", "device": "/dev/sdb"}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:43:20.308101 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-f62e5426-9c73-4d0a-b53f-6f0dbb32b9e8 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] [instance: d248123c-9c79-4d05-8d4c-b76c00ff08f3] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:43:20.314535 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f62e5426-9c73-4d0a-b53f-6f0dbb32b9e8 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:43:20.314986 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f62e5426-9c73-4d0a-b53f-6f0dbb32b9e8 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:43:20.315785 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f62e5426-9c73-4d0a-b53f-6f0dbb32b9e8 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:43:20.316257 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f62e5426-9c73-4d0a-b53f-6f0dbb32b9e8 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:43:20.546045 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f62e5426-9c73-4d0a-b53f-6f0dbb32b9e8 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] 10.222.0.16 "POST /compute/v2.1/servers/d248123c-9c79-4d05-8d4c-b76c00ff08f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.243254 May 23 12:43:20.546611 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 480/971] 10.222.0.16 () {60 vars in 1322 bytes} [Mon May 23 12:43:20 2022] POST /compute/v2.1/servers/d248123c-9c79-4d05-8d4c-b76c00ff08f3/os-volume_attachments => generated 194 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:43:38.800541 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-1ca5bb73-3630-4e8b-9605-584481ad1e0c tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:43:38.801052 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-1ca5bb73-3630-4e8b-9605-584481ad1e0c tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] [instance: d248123c-9c79-4d05-8d4c-b76c00ff08f3] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:43:38.803167 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_api:SELECT=15 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:43:38.804460 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell1:SELECT=35 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:43:38.810624 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1ca5bb73-3630-4e8b-9605-584481ad1e0c tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:43:38.811068 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1ca5bb73-3630-4e8b-9605-584481ad1e0c tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:43:38.811826 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1ca5bb73-3630-4e8b-9605-584481ad1e0c tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:43:38.812283 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1ca5bb73-3630-4e8b-9605-584481ad1e0c tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:43:38.894516 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.objects.instance [None req-1ca5bb73-3630-4e8b-9605-584481ad1e0c tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lazy-loading 'services' on Instance uuid d248123c-9c79-4d05-8d4c-b76c00ff08f3 {{(pid=124200) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:43:38.966436 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-1ca5bb73-3630-4e8b-9605-584481ad1e0c tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d248123c-9c79-4d05-8d4c-b76c00ff08f3/os-volume_attachments/58ff88c1-c62b-42c6-9028-125926c64fdf" status: 202 len: 0 microversion: 2.1 time: 0.169598 May 23 12:43:38.967025 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 492/972] 10.222.0.16 () {58 vars in 1415 bytes} [Mon May 23 12:43:38 2022] DELETE /compute/v2.1/servers/d248123c-9c79-4d05-8d4c-b76c00ff08f3/os-volume_attachments/58ff88c1-c62b-42c6-9028-125926c64fdf => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:43:40.079118 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_api:SELECT=13 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:43:40.079912 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:43:40.084634 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-e015e753-c12b-48f5-8079-f5a7fce0ad0f tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:43:40.085855 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-e015e753-c12b-48f5-8079-f5a7fce0ad0f tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] [instance: d248123c-9c79-4d05-8d4c-b76c00ff08f3] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:43:40.093807 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e015e753-c12b-48f5-8079-f5a7fce0ad0f tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:43:40.094260 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e015e753-c12b-48f5-8079-f5a7fce0ad0f tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:43:40.095030 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e015e753-c12b-48f5-8079-f5a7fce0ad0f tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:43:40.095469 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e015e753-c12b-48f5-8079-f5a7fce0ad0f tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:43:40.120926 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-e015e753-c12b-48f5-8079-f5a7fce0ad0f tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] [instance: d248123c-9c79-4d05-8d4c-b76c00ff08f3] Going to try to terminate instance {{(pid=124199) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 12:43:40.195962 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-e015e753-c12b-48f5-8079-f5a7fce0ad0f tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d248123c-9c79-4d05-8d4c-b76c00ff08f3" status: 204 len: 0 microversion: 2.1 time: 0.117291 May 23 12:43:40.196668 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 481/973] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 12:43:40 2022] DELETE /compute/v2.1/servers/d248123c-9c79-4d05-8d4c-b76c00ff08f3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 12:43:40.206951 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-9c8a12dd-76a3-42e9-ade6-f264faced14e tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:43:40.207687 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-9c8a12dd-76a3-42e9-ade6-f264faced14e tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] [instance: d248123c-9c79-4d05-8d4c-b76c00ff08f3] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:43:40.214210 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9c8a12dd-76a3-42e9-ade6-f264faced14e tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:43:40.214661 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9c8a12dd-76a3-42e9-ade6-f264faced14e tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:43:40.215453 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9c8a12dd-76a3-42e9-ade6-f264faced14e tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:43:40.215895 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9c8a12dd-76a3-42e9-ade6-f264faced14e tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:43:40.349907 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-9c8a12dd-76a3-42e9-ade6-f264faced14e tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c4f8f2298d4014b2a08aaa391751f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05c15fec3294719b7f8bc5690f355f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:43:40.357618 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-9c8a12dd-76a3-42e9-ade6-f264faced14e tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] 10.222.0.16 "GET /compute/v2.1/servers/d248123c-9c79-4d05-8d4c-b76c00ff08f3" status: 200 len: 1514 microversion: 2.1 time: 0.155626 May 23 12:43:40.358263 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 493/974] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:43:40 2022] GET /compute/v2.1/servers/d248123c-9c79-4d05-8d4c-b76c00ff08f3 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:43:41.376522 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d7c83450-5735-4e2d-895f-76db39d18d41 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:43:41.377218 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d7c83450-5735-4e2d-895f-76db39d18d41 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] [instance: d248123c-9c79-4d05-8d4c-b76c00ff08f3] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:43:41.384406 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d7c83450-5735-4e2d-895f-76db39d18d41 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:43:41.384851 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d7c83450-5735-4e2d-895f-76db39d18d41 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:43:41.385614 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d7c83450-5735-4e2d-895f-76db39d18d41 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:43:41.386100 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d7c83450-5735-4e2d-895f-76db39d18d41 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:43:41.518927 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d7c83450-5735-4e2d-895f-76db39d18d41 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c4f8f2298d4014b2a08aaa391751f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05c15fec3294719b7f8bc5690f355f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:43:41.527486 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d7c83450-5735-4e2d-895f-76db39d18d41 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] 10.222.0.16 "GET /compute/v2.1/servers/d248123c-9c79-4d05-8d4c-b76c00ff08f3" status: 200 len: 1514 microversion: 2.1 time: 0.155217 May 23 12:43:41.528042 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 482/975] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:43:41 2022] GET /compute/v2.1/servers/d248123c-9c79-4d05-8d4c-b76c00ff08f3 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:43:42.342001 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-0a4e16f4-56d0-4384-b94c-f8c8c4832e5e req-f192731a-e002-42b2-805a-0a8ad986be1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d248123c-9c79-4d05-8d4c-b76c00ff08f3", "name": "network-vif-deleted", "tag": "5792b05e-3aab-4acc-bdc2-54ef03b163f0"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:43:42.352052 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-0a4e16f4-56d0-4384-b94c-f8c8c4832e5e req-f192731a-e002-42b2-805a-0a8ad986be1b service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:43:42.352754 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-0a4e16f4-56d0-4384-b94c-f8c8c4832e5e req-f192731a-e002-42b2-805a-0a8ad986be1b service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:43:42.364387 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-0a4e16f4-56d0-4384-b94c-f8c8c4832e5e req-f192731a-e002-42b2-805a-0a8ad986be1b service nova] Creating event network-vif-deleted:5792b05e-3aab-4acc-bdc2-54ef03b163f0 for instance d248123c-9c79-4d05-8d4c-b76c00ff08f3 on hv-cinder-83699 May 23 12:43:42.370480 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-0a4e16f4-56d0-4384-b94c-f8c8c4832e5e req-f192731a-e002-42b2-805a-0a8ad986be1b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032093 May 23 12:43:42.371073 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 494/976] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:43:42.544519 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-aface7ed-2fcb-4b03-8e2f-646f8f4691b1 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:43:42.545120 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-aface7ed-2fcb-4b03-8e2f-646f8f4691b1 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] [instance: d248123c-9c79-4d05-8d4c-b76c00ff08f3] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:43:42.551499 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-aface7ed-2fcb-4b03-8e2f-646f8f4691b1 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:43:42.551953 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-aface7ed-2fcb-4b03-8e2f-646f8f4691b1 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:43:42.552751 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-aface7ed-2fcb-4b03-8e2f-646f8f4691b1 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:43:42.553188 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-aface7ed-2fcb-4b03-8e2f-646f8f4691b1 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:43:42.584987 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-aface7ed-2fcb-4b03-8e2f-646f8f4691b1 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:43:42.585413 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-aface7ed-2fcb-4b03-8e2f-646f8f4691b1 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:43:42.585858 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.objects.instance [None req-aface7ed-2fcb-4b03-8e2f-646f8f4691b1 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lazy-loading 'fault' on Instance uuid d248123c-9c79-4d05-8d4c-b76c00ff08f3 {{(pid=124199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:43:42.626182 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-aface7ed-2fcb-4b03-8e2f-646f8f4691b1 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c4f8f2298d4014b2a08aaa391751f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05c15fec3294719b7f8bc5690f355f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:43:42.634430 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-aface7ed-2fcb-4b03-8e2f-646f8f4691b1 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] 10.222.0.16 "GET /compute/v2.1/servers/d248123c-9c79-4d05-8d4c-b76c00ff08f3" status: 200 len: 1308 microversion: 2.1 time: 0.093912 May 23 12:43:42.635521 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 483/977] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:43:42 2022] GET /compute/v2.1/servers/d248123c-9c79-4d05-8d4c-b76c00ff08f3 => generated 1308 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:43:43.653335 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-7a6ac159-207c-4094-b37a-0750aed0acd6 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:43:43.654311 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-7a6ac159-207c-4094-b37a-0750aed0acd6 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] [instance: d248123c-9c79-4d05-8d4c-b76c00ff08f3] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:43:43.660587 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7a6ac159-207c-4094-b37a-0750aed0acd6 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:43:43.661033 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7a6ac159-207c-4094-b37a-0750aed0acd6 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:43:43.661801 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7a6ac159-207c-4094-b37a-0750aed0acd6 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:43:43.662226 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7a6ac159-207c-4094-b37a-0750aed0acd6 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:43:43.676469 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.wsgi [None req-7a6ac159-207c-4094-b37a-0750aed0acd6 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] HTTP exception thrown: Instance d248123c-9c79-4d05-8d4c-b76c00ff08f3 could not be found. May 23 12:43:43.678080 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-7a6ac159-207c-4094-b37a-0750aed0acd6 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Request method failure captured: May 23 12:43:43.678080 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: request: GET /compute/v2.1/servers/d248123c-9c79-4d05-8d4c-b76c00ff08f3 HTTP/1.1 May 23 12:43:43.678080 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept: application/json May 23 12:43:43.678080 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept-Encoding: identity May 23 12:43:43.678080 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Connection: close May 23 12:43:43.678080 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Length: 0 May 23 12:43:43.678080 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Type: application/json May 23 12:43:43.678080 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Host: 10.222.0.16 May 23 12:43:43.678080 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Openstack-System-Scope: None May 23 12:43:43.678080 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: User-Agent: python-urllib3/1.26.9 May 23 12:43:43.678080 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Auth-Token: gAAAAABii4Ea60jszWsxl0Pz92S1gepQykRt0BNkdzv-N_uJualWsRXOZtQB4T_SMnNteYlKcx15lFbTlhe1ap_VFVYriN6Exm9Ep8Rwe_ISzg4MsHlzLRr91kDo1i9Ia4qKuJc6arfLTJHmYwbiWZhvzF-2A-uluxCW1wlpxNfq78Eiw6AFrUI May 23 12:43:43.678080 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Id: None May 23 12:43:43.678080 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Name: None May 23 12:43:43.678080 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Identity-Status: Confirmed May 23 12:43:43.678080 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Is-Admin-Project: True May 23 12:43:43.678080 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Id: default May 23 12:43:43.678080 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Name: Default May 23 12:43:43.678080 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Id: d05c15fec3294719b7f8bc5690f355f9 May 23 12:43:43.678080 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Name: tempest-VolumesSnapshotTestJSON-478383476 May 23 12:43:43.678080 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Role: member,reader May 23 12:43:43.678080 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Roles: member,reader May 23 12:43:43.680546 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d05c15fec3294719b7f8bc5690f355f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d05c15fec3294719b7f8bc5690f355f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d05c15fec3294719b7f8bc5690f355f9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d05c15fec3294719b7f8bc5690f355f9"}]}] May 23 12:43:43.680546 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant: tempest-VolumesSnapshotTestJSON-478383476 May 23 12:43:43.680546 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Id: d05c15fec3294719b7f8bc5690f355f9 May 23 12:43:43.680546 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-478383476 May 23 12:43:43.680546 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User: tempest-VolumesSnapshotTestJSON-478383476-project May 23 12:43:43.680546 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Id: default May 23 12:43:43.680546 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Name: Default May 23 12:43:43.680546 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Id: c7c4f8f2298d4014b2a08aaa391751f9 May 23 12:43:43.680546 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Name: tempest-VolumesSnapshotTestJSON-478383476-project May 23 12:43:43.680546 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: method: > May 23 12:43:43.680546 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: exception: Instance d248123c-9c79-4d05-8d4c-b76c00ff08f3 could not be found. May 23 12:43:43.680546 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: action_args: {'id': 'd248123c-9c79-4d05-8d4c-b76c00ff08f3'} May 23 12:43:43.681585 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:43:43.681585 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:43:43.681585 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:43:43.681585 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:43:43.681585 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:43:43.681585 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:43:43.681585 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:43:43.681585 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:43:43.681585 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:43:43.681585 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:43:43.681585 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d248123c-9c79-4d05-8d4c-b76c00ff08f3 could not be found. May 23 12:43:43.681585 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:43:43.681585 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:43:43.681585 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:43:43.681585 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:43:43.681585 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:43:43.681585 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:43:43.681585 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:43:43.681585 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:43:43.681585 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:43:43.683218 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:43:43.683218 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:43:43.683218 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:43:43.683218 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:43:43.683218 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:43:43.683218 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:43:43.683218 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:43:43.683218 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d248123c-9c79-4d05-8d4c-b76c00ff08f3 could not be found. May 23 12:43:43.683218 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:43:43.683218 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:43:43.683218 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:43:43.683218 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:43:43.683218 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:43:43.683218 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:43:43.683218 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:43:43.683218 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:43:43.683218 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d248123c-9c79-4d05-8d4c-b76c00ff08f3 could not be found. May 23 12:43:43.683218 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:43:43.684755 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-7a6ac159-207c-4094-b37a-0750aed0acd6 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] Returning 404 to user: Instance d248123c-9c79-4d05-8d4c-b76c00ff08f3 could not be found. {{(pid=124200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:43:43.684755 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-7a6ac159-207c-4094-b37a-0750aed0acd6 tempest-VolumesSnapshotTestJSON-478383476 tempest-VolumesSnapshotTestJSON-478383476-project] 10.222.0.16 "GET /compute/v2.1/servers/d248123c-9c79-4d05-8d4c-b76c00ff08f3" status: 404 len: 111 microversion: 2.1 time: 0.031635 May 23 12:43:43.684755 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 495/978] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:43:43 2022] GET /compute/v2.1/servers/d248123c-9c79-4d05-8d4c-b76c00ff08f3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:44:27.455154 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-a4097b69-9ced-49c2-b914-5058d52a2c29 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Action: 'create', calling method: .version_select at 0x7f095d38a1f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1461676773", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHxsE1UhZo6FkU6NhVRXiSrzW1asMLVfaioAQQcPUtsDcoL5ttE/Ut6OQOuhuI3a+tuCX8SjiMQws2UqLhLG5lsLJ88u1IJCdiNNZ7/472pzhggU5lt35dtdHFI9Yt2QuQ=="}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:44:27.460093 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:44:27.460769 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:44:27.475622 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-a4097b69-9ced-49c2-b914-5058d52a2c29 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Getting quotas for project cf51a0c52de248fdb85a7cee23739b4e. Resources: {'key_pairs'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:44:27.480709 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-a4097b69-9ced-49c2-b914-5058d52a2c29 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Getting quotas for user fd9f4184defc406e8fd753eac219341a and project cf51a0c52de248fdb85a7cee23739b4e. Resources: {'key_pairs'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:44:27.510641 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-a4097b69-9ced-49c2-b914-5058d52a2c29 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.059015 May 23 12:44:27.511431 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 484/979] 10.222.0.16 () {60 vars in 1158 bytes} [Mon May 23 12:44:27 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:44:27.560486 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-c62cddc8-a5bd-4508-ad4d-bd43bd6a51c1 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1671479694", "imageRef": "7b3fcec0-fa7d-4e9d-9e78-c9462d77be2d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1461676773", "networks": [{"uuid": "6d78aefa-528d-494f-b860-ca37a4057a3e"}]}} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:44:27.567588 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_api:SELECT=8 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:44:27.568263 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:44:27.613693 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.network.neutron [None req-c62cddc8-a5bd-4508-ad4d-bd43bd6a51c1 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] validate_networks() for [('6d78aefa-528d-494f-b860-ca37a4057a3e', None, None, None, None, None)] {{(pid=124200) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 12:44:28.014222 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-c62cddc8-a5bd-4508-ad4d-bd43bd6a51c1 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Flavor limits 0:0:0 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 12:44:28.014646 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-c62cddc8-a5bd-4508-ad4d-bd43bd6a51c1 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Image limits 0:0:0 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 12:44:28.015147 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-c62cddc8-a5bd-4508-ad4d-bd43bd6a51c1 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Flavor pref 0:0:0 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 12:44:28.015554 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-c62cddc8-a5bd-4508-ad4d-bd43bd6a51c1 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Image pref 0:0:0 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 12:44:28.015965 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-c62cddc8-a5bd-4508-ad4d-bd43bd6a51c1 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 12:44:28.025531 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c62cddc8-a5bd-4508-ad4d-bd43bd6a51c1 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:28.026736 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c62cddc8-a5bd-4508-ad4d-bd43bd6a51c1 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:28.027545 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c62cddc8-a5bd-4508-ad4d-bd43bd6a51c1 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:28.028012 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c62cddc8-a5bd-4508-ad4d-bd43bd6a51c1 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:28.045772 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.quota [None req-c62cddc8-a5bd-4508-ad4d-bd43bd6a51c1 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Getting quotas for project cf51a0c52de248fdb85a7cee23739b4e. Resources: {'instances', 'cores', 'ram'} {{(pid=124200) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:44:28.049693 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.quota [None req-c62cddc8-a5bd-4508-ad4d-bd43bd6a51c1 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Getting quotas for user fd9f4184defc406e8fd753eac219341a and project cf51a0c52de248fdb85a7cee23739b4e. Resources: {'instances', 'cores', 'ram'} {{(pid=124200) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:44:28.060716 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-c62cddc8-a5bd-4508-ad4d-bd43bd6a51c1 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Going to run 1 instances... {{(pid=124200) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 12:44:28.062920 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-c62cddc8-a5bd-4508-ad4d-bd43bd6a51c1 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b3fcec0-fa7d-4e9d-9e78-c9462d77be2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124200) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 12:44:28.109727 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-c62cddc8-a5bd-4508-ad4d-bd43bd6a51c1 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.554292 May 23 12:44:28.110362 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 496/980] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 23 12:44:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 12:44:28.120432 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-879606f1-013a-4918-a5f5-bf22da005462 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:44:28.121047 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-879606f1-013a-4918-a5f5-bf22da005462 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:44:28.181328 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-879606f1-013a-4918-a5f5-bf22da005462 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9f4184defc406e8fd753eac219341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51a0c52de248fdb85a7cee23739b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:44:28.187937 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-879606f1-013a-4918-a5f5-bf22da005462 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21" status: 200 len: 1259 microversion: 2.1 time: 0.071549 May 23 12:44:28.188538 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 485/981] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:44:28 2022] GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21 => generated 1259 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:44:29.206176 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-4ce82b54-9ed6-49c4-a332-f9861b20ef8a tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:44:29.206937 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-4ce82b54-9ed6-49c4-a332-f9861b20ef8a tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:44:29.214012 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4ce82b54-9ed6-49c4-a332-f9861b20ef8a tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:29.214786 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4ce82b54-9ed6-49c4-a332-f9861b20ef8a tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:29.215572 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4ce82b54-9ed6-49c4-a332-f9861b20ef8a tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:29.216010 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4ce82b54-9ed6-49c4-a332-f9861b20ef8a tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:29.284778 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-4ce82b54-9ed6-49c4-a332-f9861b20ef8a tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9f4184defc406e8fd753eac219341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51a0c52de248fdb85a7cee23739b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:44:29.293123 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-4ce82b54-9ed6-49c4-a332-f9861b20ef8a tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21" status: 200 len: 1329 microversion: 2.1 time: 0.091759 May 23 12:44:29.293688 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 497/982] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:44:29 2022] GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21 => generated 1329 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:44:30.311061 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-404822fd-588f-482c-a95a-4a23d9aff7d8 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:44:30.311986 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-404822fd-588f-482c-a95a-4a23d9aff7d8 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:44:30.321867 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-404822fd-588f-482c-a95a-4a23d9aff7d8 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:30.322790 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-404822fd-588f-482c-a95a-4a23d9aff7d8 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:30.323812 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-404822fd-588f-482c-a95a-4a23d9aff7d8 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:30.324467 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-404822fd-588f-482c-a95a-4a23d9aff7d8 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:30.471157 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-404822fd-588f-482c-a95a-4a23d9aff7d8 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9f4184defc406e8fd753eac219341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51a0c52de248fdb85a7cee23739b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:44:30.479816 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-404822fd-588f-482c-a95a-4a23d9aff7d8 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21" status: 200 len: 1359 microversion: 2.1 time: 0.172794 May 23 12:44:30.480432 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 486/983] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:44:30 2022] GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:44:31.497729 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-631de9f2-d584-4bd7-a859-301f0d82697a tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:44:31.498398 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-631de9f2-d584-4bd7-a859-301f0d82697a tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:44:31.505480 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-631de9f2-d584-4bd7-a859-301f0d82697a tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:31.505931 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-631de9f2-d584-4bd7-a859-301f0d82697a tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:31.506722 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-631de9f2-d584-4bd7-a859-301f0d82697a tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:31.507162 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-631de9f2-d584-4bd7-a859-301f0d82697a tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:31.653553 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-631de9f2-d584-4bd7-a859-301f0d82697a tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9f4184defc406e8fd753eac219341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51a0c52de248fdb85a7cee23739b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:44:31.662443 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-631de9f2-d584-4bd7-a859-301f0d82697a tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21" status: 200 len: 1359 microversion: 2.1 time: 0.168903 May 23 12:44:31.663017 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 498/984] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:44:31 2022] GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:44:32.681933 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-520768d5-6d47-43eb-b332-05bde73d7cdf tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:44:32.682979 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-520768d5-6d47-43eb-b332-05bde73d7cdf tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:44:32.690077 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-520768d5-6d47-43eb-b332-05bde73d7cdf tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:32.690689 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-520768d5-6d47-43eb-b332-05bde73d7cdf tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:32.691315 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-520768d5-6d47-43eb-b332-05bde73d7cdf tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:32.691768 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-520768d5-6d47-43eb-b332-05bde73d7cdf tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:32.844519 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-520768d5-6d47-43eb-b332-05bde73d7cdf tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9f4184defc406e8fd753eac219341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51a0c52de248fdb85a7cee23739b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:44:32.853069 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-520768d5-6d47-43eb-b332-05bde73d7cdf tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21" status: 200 len: 1359 microversion: 2.1 time: 0.176049 May 23 12:44:32.854012 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 487/985] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:44:32 2022] GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:44:33.872799 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-9589dfc6-eeb0-4cfa-af08-81a9a550a88a tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:44:33.873511 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-9589dfc6-eeb0-4cfa-af08-81a9a550a88a tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:44:33.884698 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9589dfc6-eeb0-4cfa-af08-81a9a550a88a tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:33.886667 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9589dfc6-eeb0-4cfa-af08-81a9a550a88a tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:33.887852 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9589dfc6-eeb0-4cfa-af08-81a9a550a88a tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:33.888621 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-9589dfc6-eeb0-4cfa-af08-81a9a550a88a tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:34.065446 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-9589dfc6-eeb0-4cfa-af08-81a9a550a88a tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9f4184defc406e8fd753eac219341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51a0c52de248fdb85a7cee23739b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:44:34.075917 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-9589dfc6-eeb0-4cfa-af08-81a9a550a88a tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21" status: 200 len: 1359 microversion: 2.1 time: 0.208486 May 23 12:44:34.087459 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 499/986] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:44:33 2022] GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21 => generated 1359 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:44:35.097279 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-6bf237f5-d371-4089-975e-aa78750e9df2 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:44:35.098024 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-6bf237f5-d371-4089-975e-aa78750e9df2 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:44:35.105141 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6bf237f5-d371-4089-975e-aa78750e9df2 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:35.105817 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6bf237f5-d371-4089-975e-aa78750e9df2 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:35.106672 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6bf237f5-d371-4089-975e-aa78750e9df2 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:35.107190 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6bf237f5-d371-4089-975e-aa78750e9df2 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:35.251091 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-6bf237f5-d371-4089-975e-aa78750e9df2 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9f4184defc406e8fd753eac219341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51a0c52de248fdb85a7cee23739b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:44:35.259163 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-6bf237f5-d371-4089-975e-aa78750e9df2 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21" status: 200 len: 1359 microversion: 2.1 time: 0.166223 May 23 12:44:35.260577 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 488/987] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:44:35 2022] GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:44:36.278029 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-ab7c4f7f-13ef-404b-9561-969a42ed8aa3 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:44:36.278687 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-ab7c4f7f-13ef-404b-9561-969a42ed8aa3 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:44:36.295807 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ab7c4f7f-13ef-404b-9561-969a42ed8aa3 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:36.296280 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ab7c4f7f-13ef-404b-9561-969a42ed8aa3 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:36.297075 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ab7c4f7f-13ef-404b-9561-969a42ed8aa3 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:36.297513 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ab7c4f7f-13ef-404b-9561-969a42ed8aa3 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:36.440872 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-ab7c4f7f-13ef-404b-9561-969a42ed8aa3 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9f4184defc406e8fd753eac219341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51a0c52de248fdb85a7cee23739b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:44:36.449519 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-ab7c4f7f-13ef-404b-9561-969a42ed8aa3 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21" status: 200 len: 1359 microversion: 2.1 time: 0.175319 May 23 12:44:36.450411 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 500/988] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:44:36 2022] GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:44:37.467277 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-5650aaaa-35d8-404e-825c-76f7a76ab21c tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:44:37.468131 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-5650aaaa-35d8-404e-825c-76f7a76ab21c tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:44:37.474637 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5650aaaa-35d8-404e-825c-76f7a76ab21c tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:37.475085 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5650aaaa-35d8-404e-825c-76f7a76ab21c tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:37.475855 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5650aaaa-35d8-404e-825c-76f7a76ab21c tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:37.476328 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5650aaaa-35d8-404e-825c-76f7a76ab21c tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:37.613152 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-5650aaaa-35d8-404e-825c-76f7a76ab21c tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9f4184defc406e8fd753eac219341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51a0c52de248fdb85a7cee23739b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:44:37.621105 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-5650aaaa-35d8-404e-825c-76f7a76ab21c tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21" status: 200 len: 1359 microversion: 2.1 time: 0.158338 May 23 12:44:37.621681 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 489/989] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:44:37 2022] GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:44:38.006822 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-fd214c43-ca6b-4421-beb3-885071bffbd6 req-d342d315-3019-48c8-84e4-35f3ffcaa601 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f66733e1-e43c-4011-b271-ef705a2a9b21", "tag": "45b3dda8-fb5f-4e14-8992-d8f97790fbdc"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:44:38.016604 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-fd214c43-ca6b-4421-beb3-885071bffbd6 req-d342d315-3019-48c8-84e4-35f3ffcaa601 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:38.017362 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-fd214c43-ca6b-4421-beb3-885071bffbd6 req-d342d315-3019-48c8-84e4-35f3ffcaa601 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:38.033802 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-fd214c43-ca6b-4421-beb3-885071bffbd6 req-d342d315-3019-48c8-84e4-35f3ffcaa601 service nova] Creating event network-changed:45b3dda8-fb5f-4e14-8992-d8f97790fbdc for instance f66733e1-e43c-4011-b271-ef705a2a9b21 on hv-cinder-83699 May 23 12:44:38.039012 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-fd214c43-ca6b-4421-beb3-885071bffbd6 req-d342d315-3019-48c8-84e4-35f3ffcaa601 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180925 May 23 12:44:38.040065 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 501/990] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:44:38.640202 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f0c4d357-1993-48dd-8e25-5d05d46a8f20 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:44:38.640823 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-f0c4d357-1993-48dd-8e25-5d05d46a8f20 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:44:38.642893 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell0:SELECT=6 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:44:38.648795 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f0c4d357-1993-48dd-8e25-5d05d46a8f20 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:38.649243 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f0c4d357-1993-48dd-8e25-5d05d46a8f20 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:38.650018 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f0c4d357-1993-48dd-8e25-5d05d46a8f20 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:38.650454 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f0c4d357-1993-48dd-8e25-5d05d46a8f20 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:38.787048 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f0c4d357-1993-48dd-8e25-5d05d46a8f20 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9f4184defc406e8fd753eac219341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51a0c52de248fdb85a7cee23739b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:44:38.794549 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f0c4d357-1993-48dd-8e25-5d05d46a8f20 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21" status: 200 len: 1359 microversion: 2.1 time: 0.160296 May 23 12:44:38.795115 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 490/991] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:44:38 2022] GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:44:39.812008 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-d8efd4ed-cc76-4324-8e94-e08dceb5f8fe tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:44:39.812779 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-d8efd4ed-cc76-4324-8e94-e08dceb5f8fe tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:44:39.814683 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell0:SELECT=2 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:44:39.815329 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell0:SELECT=6 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:44:39.822019 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d8efd4ed-cc76-4324-8e94-e08dceb5f8fe tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:39.822464 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d8efd4ed-cc76-4324-8e94-e08dceb5f8fe tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:39.823342 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d8efd4ed-cc76-4324-8e94-e08dceb5f8fe tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:39.823774 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d8efd4ed-cc76-4324-8e94-e08dceb5f8fe tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:39.957988 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-d8efd4ed-cc76-4324-8e94-e08dceb5f8fe tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9f4184defc406e8fd753eac219341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51a0c52de248fdb85a7cee23739b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:44:39.966473 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-d8efd4ed-cc76-4324-8e94-e08dceb5f8fe tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21" status: 200 len: 1359 microversion: 2.1 time: 0.158766 May 23 12:44:39.967030 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 502/992] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:44:39 2022] GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:44:40.983143 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c73fe930-5bba-486e-9fda-7c5b3b3e7a64 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:44:40.983683 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c73fe930-5bba-486e-9fda-7c5b3b3e7a64 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:44:40.990225 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c73fe930-5bba-486e-9fda-7c5b3b3e7a64 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:40.990669 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c73fe930-5bba-486e-9fda-7c5b3b3e7a64 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:40.991427 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c73fe930-5bba-486e-9fda-7c5b3b3e7a64 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:40.991855 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c73fe930-5bba-486e-9fda-7c5b3b3e7a64 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:41.120009 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c73fe930-5bba-486e-9fda-7c5b3b3e7a64 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9f4184defc406e8fd753eac219341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51a0c52de248fdb85a7cee23739b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:44:41.127493 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c73fe930-5bba-486e-9fda-7c5b3b3e7a64 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21" status: 200 len: 1359 microversion: 2.1 time: 0.148546 May 23 12:44:41.128054 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 491/993] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:44:40 2022] GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:44:42.145041 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-7097c224-8094-4245-9535-6f190cc1ffb2 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:44:42.145631 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-7097c224-8094-4245-9535-6f190cc1ffb2 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:44:42.152761 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7097c224-8094-4245-9535-6f190cc1ffb2 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:42.153210 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7097c224-8094-4245-9535-6f190cc1ffb2 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:42.153979 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7097c224-8094-4245-9535-6f190cc1ffb2 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:42.154413 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7097c224-8094-4245-9535-6f190cc1ffb2 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:42.298292 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-7097c224-8094-4245-9535-6f190cc1ffb2 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9f4184defc406e8fd753eac219341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51a0c52de248fdb85a7cee23739b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:44:42.306234 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-7097c224-8094-4245-9535-6f190cc1ffb2 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21" status: 200 len: 1359 microversion: 2.1 time: 0.164954 May 23 12:44:42.306941 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 503/994] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:44:42 2022] GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:44:43.324700 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-9f1830da-540d-4939-8cc3-804a834318b5 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:44:43.325262 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-9f1830da-540d-4939-8cc3-804a834318b5 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:44:43.332131 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9f1830da-540d-4939-8cc3-804a834318b5 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:43.332620 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9f1830da-540d-4939-8cc3-804a834318b5 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:43.333474 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9f1830da-540d-4939-8cc3-804a834318b5 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:43.333912 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9f1830da-540d-4939-8cc3-804a834318b5 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:43.471648 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9f1830da-540d-4939-8cc3-804a834318b5 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9f4184defc406e8fd753eac219341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51a0c52de248fdb85a7cee23739b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:44:43.479322 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-9f1830da-540d-4939-8cc3-804a834318b5 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21" status: 200 len: 1359 microversion: 2.1 time: 0.159874 May 23 12:44:43.480122 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 492/995] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:44:43 2022] GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:44:44.469477 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-23519807-1441-4c41-8d60-f9e6e2ab52e8 req-a29512d1-18fa-4954-8120-d9100c45ed8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f66733e1-e43c-4011-b271-ef705a2a9b21", "name": "network-vif-plugged", "status": "completed", "tag": "45b3dda8-fb5f-4e14-8992-d8f97790fbdc"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:44:44.479545 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-23519807-1441-4c41-8d60-f9e6e2ab52e8 req-a29512d1-18fa-4954-8120-d9100c45ed8c service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:44.479999 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-23519807-1441-4c41-8d60-f9e6e2ab52e8 req-a29512d1-18fa-4954-8120-d9100c45ed8c service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:44.492165 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-23519807-1441-4c41-8d60-f9e6e2ab52e8 req-a29512d1-18fa-4954-8120-d9100c45ed8c service nova] Creating event network-vif-plugged:45b3dda8-fb5f-4e14-8992-d8f97790fbdc for instance f66733e1-e43c-4011-b271-ef705a2a9b21 on hv-cinder-83699 May 23 12:44:44.498142 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-23519807-1441-4c41-8d60-f9e6e2ab52e8 req-a29512d1-18fa-4954-8120-d9100c45ed8c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124116 May 23 12:44:44.498361 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-ae127462-1e54-41fa-bb9f-2d1c4882964a tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:44:44.499016 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 504/996] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:44:44.499165 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-ae127462-1e54-41fa-bb9f-2d1c4882964a tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:44:44.506479 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ae127462-1e54-41fa-bb9f-2d1c4882964a tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:44.506933 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ae127462-1e54-41fa-bb9f-2d1c4882964a tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:44.507736 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ae127462-1e54-41fa-bb9f-2d1c4882964a tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:44.508192 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ae127462-1e54-41fa-bb9f-2d1c4882964a tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:44.645487 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-ae127462-1e54-41fa-bb9f-2d1c4882964a tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9f4184defc406e8fd753eac219341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51a0c52de248fdb85a7cee23739b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:44:44.654357 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-ae127462-1e54-41fa-bb9f-2d1c4882964a tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21" status: 200 len: 1359 microversion: 2.1 time: 0.160973 May 23 12:44:44.654949 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 493/997] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:44:44 2022] GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:44:45.672632 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-25a78664-f7a1-45c7-a409-4717bd902050 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:44:45.673336 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-25a78664-f7a1-45c7-a409-4717bd902050 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:44:45.679874 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-25a78664-f7a1-45c7-a409-4717bd902050 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:45.680361 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-25a78664-f7a1-45c7-a409-4717bd902050 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:45.681139 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-25a78664-f7a1-45c7-a409-4717bd902050 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:45.681576 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-25a78664-f7a1-45c7-a409-4717bd902050 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:45.823504 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-25a78664-f7a1-45c7-a409-4717bd902050 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9f4184defc406e8fd753eac219341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51a0c52de248fdb85a7cee23739b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:44:45.831709 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-25a78664-f7a1-45c7-a409-4717bd902050 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21" status: 200 len: 1359 microversion: 2.1 time: 0.164362 May 23 12:44:45.832310 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 505/998] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:44:45 2022] GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:44:46.849401 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-5bf640e5-5842-4c3c-a8e6-3b0f6ceb9de8 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:44:46.850078 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-5bf640e5-5842-4c3c-a8e6-3b0f6ceb9de8 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:44:46.857543 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5bf640e5-5842-4c3c-a8e6-3b0f6ceb9de8 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:46.857994 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5bf640e5-5842-4c3c-a8e6-3b0f6ceb9de8 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:46.858762 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5bf640e5-5842-4c3c-a8e6-3b0f6ceb9de8 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:46.859195 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5bf640e5-5842-4c3c-a8e6-3b0f6ceb9de8 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:46.995075 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-5bf640e5-5842-4c3c-a8e6-3b0f6ceb9de8 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9f4184defc406e8fd753eac219341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51a0c52de248fdb85a7cee23739b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:44:47.003465 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-5bf640e5-5842-4c3c-a8e6-3b0f6ceb9de8 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21" status: 200 len: 1548 microversion: 2.1 time: 0.157982 May 23 12:44:47.004035 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 494/999] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:44:46 2022] GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21 => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:44:47.019532 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-e7f547d1-26d1-4e73-a2ab-f75bf8e6d696 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:44:47.020328 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-e7f547d1-26d1-4e73-a2ab-f75bf8e6d696 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:44:47.027534 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e7f547d1-26d1-4e73-a2ab-f75bf8e6d696 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:47.028153 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e7f547d1-26d1-4e73-a2ab-f75bf8e6d696 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:47.028985 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e7f547d1-26d1-4e73-a2ab-f75bf8e6d696 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:47.029423 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e7f547d1-26d1-4e73-a2ab-f75bf8e6d696 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:47.174098 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-e7f547d1-26d1-4e73-a2ab-f75bf8e6d696 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9f4184defc406e8fd753eac219341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51a0c52de248fdb85a7cee23739b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:44:47.182109 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-e7f547d1-26d1-4e73-a2ab-f75bf8e6d696 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21" status: 200 len: 1548 microversion: 2.1 time: 0.166358 May 23 12:44:47.183012 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 506/1000] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:44:47 2022] GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21 => generated 1548 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:44:47.203051 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d21fdfd6-99f7-42bc-815b-b417cc59a687 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:44:47.208101 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d21fdfd6-99f7-42bc-815b-b417cc59a687 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fd9f4184defc406e8fd753eac219341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51a0c52de248fdb85a7cee23739b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:44:47.208974 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d21fdfd6-99f7-42bc-815b-b417cc59a687 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Searching by: {'deleted': False, 'project_id': 'cf51a0c52de248fdb85a7cee23739b4e'} {{(pid=124199) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 23 12:44:47.216924 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d21fdfd6-99f7-42bc-815b-b417cc59a687 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:47.217373 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d21fdfd6-99f7-42bc-815b-b417cc59a687 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:47.218176 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d21fdfd6-99f7-42bc-815b-b417cc59a687 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:47.218619 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d21fdfd6-99f7-42bc-815b-b417cc59a687 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:47.325706 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.multi_cell_list [None req-d21fdfd6-99f7-42bc-815b-b417cc59a687 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124199) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 23 12:44:47.438641 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d21fdfd6-99f7-42bc-815b-b417cc59a687 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.239661 May 23 12:44:47.439234 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 495/1001] 10.222.0.16 () {58 vars in 1124 bytes} [Mon May 23 12:44:47 2022] GET /compute/v2.1/servers => generated 343 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:44:47.449430 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-c6d04353-34eb-4e71-9337-498e84a82e80 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:44:47.450043 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-c6d04353-34eb-4e71-9337-498e84a82e80 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:44:47.456404 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c6d04353-34eb-4e71-9337-498e84a82e80 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:47.456799 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c6d04353-34eb-4e71-9337-498e84a82e80 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:47.457565 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c6d04353-34eb-4e71-9337-498e84a82e80 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:47.458004 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-c6d04353-34eb-4e71-9337-498e84a82e80 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:47.588152 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-c6d04353-34eb-4e71-9337-498e84a82e80 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9f4184defc406e8fd753eac219341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51a0c52de248fdb85a7cee23739b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:44:47.596372 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-c6d04353-34eb-4e71-9337-498e84a82e80 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21" status: 200 len: 1548 microversion: 2.1 time: 0.150851 May 23 12:44:47.596933 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 507/1002] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:44:47 2022] GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:44:49.111083 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f2ed47aa-2b2e-4ae6-84f6-40bedf2444a7 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd587643-88ef-4751-9669-58b708f9af4a"}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:44:49.112199 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-f2ed47aa-2b2e-4ae6-84f6-40bedf2444a7 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:44:49.118811 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f2ed47aa-2b2e-4ae6-84f6-40bedf2444a7 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:49.119263 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f2ed47aa-2b2e-4ae6-84f6-40bedf2444a7 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:49.120037 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f2ed47aa-2b2e-4ae6-84f6-40bedf2444a7 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:49.120511 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f2ed47aa-2b2e-4ae6-84f6-40bedf2444a7 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:49.388668 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f2ed47aa-2b2e-4ae6-84f6-40bedf2444a7 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "POST /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281389 May 23 12:44:49.389373 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 496/1003] 10.222.0.16 () {60 vars in 1322 bytes} [Mon May 23 12:44:49 2022] POST /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:44:55.900216 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-e9b45b23-c787-4cea-a197-40305c8f451e tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:44:55.900836 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-e9b45b23-c787-4cea-a197-40305c8f451e tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:44:55.907245 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e9b45b23-c787-4cea-a197-40305c8f451e tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:55.907680 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e9b45b23-c787-4cea-a197-40305c8f451e tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:55.908470 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e9b45b23-c787-4cea-a197-40305c8f451e tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:55.908903 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-e9b45b23-c787-4cea-a197-40305c8f451e tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:56.039712 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-e9b45b23-c787-4cea-a197-40305c8f451e tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9f4184defc406e8fd753eac219341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51a0c52de248fdb85a7cee23739b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:44:56.049070 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-e9b45b23-c787-4cea-a197-40305c8f451e tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21" status: 200 len: 1594 microversion: 2.1 time: 0.152821 May 23 12:44:56.049664 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 508/1004] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:44:55 2022] GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21 => generated 1594 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:44:57.829315 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell0:SELECT=2 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:44:57.844268 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-33fe18bb-f97c-4b18-8d60-52ba7de8c03b req-0e918573-ec1c-43bf-9a37-3c919193187c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f66733e1-e43c-4011-b271-ef705a2a9b21", "tag": "45b3dda8-fb5f-4e14-8992-d8f97790fbdc"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:44:57.851866 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:44:57.854363 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-33fe18bb-f97c-4b18-8d60-52ba7de8c03b req-0e918573-ec1c-43bf-9a37-3c919193187c service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:57.854990 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-33fe18bb-f97c-4b18-8d60-52ba7de8c03b req-0e918573-ec1c-43bf-9a37-3c919193187c service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:57.863068 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:44:57.873671 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-33fe18bb-f97c-4b18-8d60-52ba7de8c03b req-0e918573-ec1c-43bf-9a37-3c919193187c service nova] Creating event network-changed:45b3dda8-fb5f-4e14-8992-d8f97790fbdc for instance f66733e1-e43c-4011-b271-ef705a2a9b21 on hv-cinder-83699 May 23 12:44:57.880827 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-33fe18bb-f97c-4b18-8d60-52ba7de8c03b req-0e918573-ec1c-43bf-9a37-3c919193187c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052936 May 23 12:44:57.881893 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 497/1005] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:44:58.929611 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-85abac56-2ffa-4a40-bbcc-2fb55577ef81 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1587278546"}} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:44:58.930667 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-85abac56-2ffa-4a40-bbcc-2fb55577ef81 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:44:58.935175 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:44:58.944382 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-85abac56-2ffa-4a40-bbcc-2fb55577ef81 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:58.945938 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-85abac56-2ffa-4a40-bbcc-2fb55577ef81 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:58.947395 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-85abac56-2ffa-4a40-bbcc-2fb55577ef81 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:58.948308 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-85abac56-2ffa-4a40-bbcc-2fb55577ef81 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:58.956931 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell1:SELECT=67 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:44:59.124321 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.network.security_group_api [None req-85abac56-2ffa-4a40-bbcc-2fb55577ef81 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Adding security group ceed8677-b38c-433b-96d9-aa6717e80a39 to port 45b3dda8-fb5f-4e14-8992-d8f97790fbdc May 23 12:44:59.543155 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-85abac56-2ffa-4a40-bbcc-2fb55577ef81 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "POST /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21/action" status: 202 len: 0 microversion: 2.1 time: 0.621883 May 23 12:44:59.544789 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 509/1006] 10.222.0.16 () {60 vars in 1277 bytes} [Mon May 23 12:44:58 2022] POST /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21/action => generated 0 bytes in 626 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:44:59.557969 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c784af60-ad27-407c-bd23-97c01998857e tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:44:59.559902 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c784af60-ad27-407c-bd23-97c01998857e tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:44:59.574624 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c784af60-ad27-407c-bd23-97c01998857e tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:59.575491 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c784af60-ad27-407c-bd23-97c01998857e tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:59.576642 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c784af60-ad27-407c-bd23-97c01998857e tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:59.577259 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c784af60-ad27-407c-bd23-97c01998857e tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:59.672596 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-536e1eac-9325-45ba-b0ae-e614c71dac6b req-f5c0b872-f2f6-4b1e-b404-7778fac2b251 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f66733e1-e43c-4011-b271-ef705a2a9b21", "tag": "45b3dda8-fb5f-4e14-8992-d8f97790fbdc"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:44:59.681786 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-536e1eac-9325-45ba-b0ae-e614c71dac6b req-f5c0b872-f2f6-4b1e-b404-7778fac2b251 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:44:59.682295 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-536e1eac-9325-45ba-b0ae-e614c71dac6b req-f5c0b872-f2f6-4b1e-b404-7778fac2b251 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:44:59.702624 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-536e1eac-9325-45ba-b0ae-e614c71dac6b req-f5c0b872-f2f6-4b1e-b404-7778fac2b251 service nova] Creating event network-changed:45b3dda8-fb5f-4e14-8992-d8f97790fbdc for instance f66733e1-e43c-4011-b271-ef705a2a9b21 on hv-cinder-83699 May 23 12:44:59.708350 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-536e1eac-9325-45ba-b0ae-e614c71dac6b req-f5c0b872-f2f6-4b1e-b404-7778fac2b251 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156213 May 23 12:44:59.709390 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 510/1007] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:44:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:44:59.805902 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c784af60-ad27-407c-bd23-97c01998857e tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9f4184defc406e8fd753eac219341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51a0c52de248fdb85a7cee23739b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:44:59.822616 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c784af60-ad27-407c-bd23-97c01998857e tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21" status: 200 len: 1760 microversion: 2.1 time: 0.273443 May 23 12:44:59.823204 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 498/1008] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:44:59 2022] GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21 => generated 1760 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:45:05.910497 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-744eda6e-7109-4e65-ac96-fd3818fcaaea tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:45:05.911105 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-744eda6e-7109-4e65-ac96-fd3818fcaaea tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 0ec9234d-3bbf-4d1f-8780-5544e03fe111] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:45:05.918027 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-744eda6e-7109-4e65-ac96-fd3818fcaaea tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:05.918505 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-744eda6e-7109-4e65-ac96-fd3818fcaaea tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:05.919395 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-744eda6e-7109-4e65-ac96-fd3818fcaaea tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:05.919741 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-744eda6e-7109-4e65-ac96-fd3818fcaaea tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:05.947385 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-744eda6e-7109-4e65-ac96-fd3818fcaaea tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 0ec9234d-3bbf-4d1f-8780-5544e03fe111] Going to try to terminate instance {{(pid=124200) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 12:45:06.033104 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-744eda6e-7109-4e65-ac96-fd3818fcaaea tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111" status: 204 len: 0 microversion: 2.1 time: 0.126593 May 23 12:45:06.033685 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 511/1009] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 12:45:05 2022] DELETE /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 12:45:06.042800 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-317fe53f-7026-42b7-9d3d-768a4d82dbe2 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:45:06.043614 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-317fe53f-7026-42b7-9d3d-768a4d82dbe2 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 0ec9234d-3bbf-4d1f-8780-5544e03fe111] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:45:06.050227 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-317fe53f-7026-42b7-9d3d-768a4d82dbe2 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:06.050678 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-317fe53f-7026-42b7-9d3d-768a4d82dbe2 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:06.051462 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-317fe53f-7026-42b7-9d3d-768a4d82dbe2 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:06.051909 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-317fe53f-7026-42b7-9d3d-768a4d82dbe2 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:06.189044 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-317fe53f-7026-42b7-9d3d-768a4d82dbe2 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:45:06.196755 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-317fe53f-7026-42b7-9d3d-768a4d82dbe2 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111" status: 200 len: 1579 microversion: 2.1 time: 0.158715 May 23 12:45:06.197812 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 499/1010] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:45:06 2022] GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111 => generated 1579 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:45:07.217472 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-eeae6c53-c28a-442e-998b-2fff122cf1bf tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:45:07.218179 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-eeae6c53-c28a-442e-998b-2fff122cf1bf tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 0ec9234d-3bbf-4d1f-8780-5544e03fe111] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:45:07.224731 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-eeae6c53-c28a-442e-998b-2fff122cf1bf tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:07.225189 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-eeae6c53-c28a-442e-998b-2fff122cf1bf tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:07.225969 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-eeae6c53-c28a-442e-998b-2fff122cf1bf tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:07.226415 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-eeae6c53-c28a-442e-998b-2fff122cf1bf tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:07.361569 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-eeae6c53-c28a-442e-998b-2fff122cf1bf tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:45:07.369106 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-eeae6c53-c28a-442e-998b-2fff122cf1bf tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111" status: 200 len: 1579 microversion: 2.1 time: 0.156832 May 23 12:45:07.369661 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 512/1011] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:45:07 2022] GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111 => generated 1579 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:45:08.386242 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-fdb93240-1004-4a80-b446-e975588670ce tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:45:08.386867 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-fdb93240-1004-4a80-b446-e975588670ce tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 0ec9234d-3bbf-4d1f-8780-5544e03fe111] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:45:08.394476 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fdb93240-1004-4a80-b446-e975588670ce tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:08.394935 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fdb93240-1004-4a80-b446-e975588670ce tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:08.395737 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fdb93240-1004-4a80-b446-e975588670ce tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:08.396193 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fdb93240-1004-4a80-b446-e975588670ce tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:08.469367 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-fdb93240-1004-4a80-b446-e975588670ce tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:45:08.477549 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-fdb93240-1004-4a80-b446-e975588670ce tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111" status: 200 len: 1511 microversion: 2.1 time: 0.095396 May 23 12:45:08.478446 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 500/1012] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:45:08 2022] GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111 => generated 1511 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:45:08.648530 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-bb72b467-0477-41d3-93fb-a30b4e118ef0 req-0222ba6b-defe-42a0-8f22-1aed69bc09b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ec9234d-3bbf-4d1f-8780-5544e03fe111", "name": "network-vif-deleted", "tag": "05be8af3-225e-46ed-b701-da573a908453"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:45:08.657592 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-bb72b467-0477-41d3-93fb-a30b4e118ef0 req-0222ba6b-defe-42a0-8f22-1aed69bc09b0 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:08.658275 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-bb72b467-0477-41d3-93fb-a30b4e118ef0 req-0222ba6b-defe-42a0-8f22-1aed69bc09b0 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:08.670178 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-bb72b467-0477-41d3-93fb-a30b4e118ef0 req-0222ba6b-defe-42a0-8f22-1aed69bc09b0 service nova] Creating event network-vif-deleted:05be8af3-225e-46ed-b701-da573a908453 for instance 0ec9234d-3bbf-4d1f-8780-5544e03fe111 on hv-cinder-83699 May 23 12:45:08.675475 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-bb72b467-0477-41d3-93fb-a30b4e118ef0 req-0222ba6b-defe-42a0-8f22-1aed69bc09b0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030613 May 23 12:45:08.676070 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 513/1013] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:45:09.494878 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-706d5bf2-6b98-4f20-aa7d-32e1a4377a30 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:45:09.495502 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-706d5bf2-6b98-4f20-aa7d-32e1a4377a30 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 0ec9234d-3bbf-4d1f-8780-5544e03fe111] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:45:09.503591 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-706d5bf2-6b98-4f20-aa7d-32e1a4377a30 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:09.504041 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-706d5bf2-6b98-4f20-aa7d-32e1a4377a30 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:09.505055 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-706d5bf2-6b98-4f20-aa7d-32e1a4377a30 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:09.505670 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-706d5bf2-6b98-4f20-aa7d-32e1a4377a30 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:09.520241 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.wsgi [None req-706d5bf2-6b98-4f20-aa7d-32e1a4377a30 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] HTTP exception thrown: Instance 0ec9234d-3bbf-4d1f-8780-5544e03fe111 could not be found. May 23 12:45:09.521891 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-706d5bf2-6b98-4f20-aa7d-32e1a4377a30 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Request method failure captured: May 23 12:45:09.521891 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: request: GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111 HTTP/1.1 May 23 12:45:09.521891 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept: application/json May 23 12:45:09.521891 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept-Encoding: identity May 23 12:45:09.521891 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Connection: close May 23 12:45:09.521891 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Length: 0 May 23 12:45:09.521891 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Type: application/json May 23 12:45:09.521891 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Host: 10.222.0.16 May 23 12:45:09.521891 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Openstack-System-Scope: None May 23 12:45:09.521891 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: User-Agent: python-urllib3/1.26.9 May 23 12:45:09.521891 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Auth-Token: gAAAAABii4Ekyf6cwYkorK1YLyy_p53XTPvC63_eNQJ2wcC3bEgrf_x8OBT3OlXsSL-P2gxXF6NAtJWekx8C05xv97nimL05Ugq9KXiXcKZIcMDZ9JTXc-NxRHw8U8Eb2OzIvM0_h-powEforGgpbP_cy7B_JnF-mpeYNUVNzfUQOPrHREBZ40s May 23 12:45:09.521891 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Id: None May 23 12:45:09.521891 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Name: None May 23 12:45:09.521891 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Identity-Status: Confirmed May 23 12:45:09.521891 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Is-Admin-Project: True May 23 12:45:09.521891 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Id: default May 23 12:45:09.521891 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Name: Default May 23 12:45:09.521891 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Id: ac5975413f5548c3881ec3c868295836 May 23 12:45:09.521891 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Name: tempest-TestVolumeBootPattern-1357796398 May 23 12:45:09.521891 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Role: member,reader May 23 12:45:09.521891 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Roles: member,reader May 23 12:45:09.523646 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ac5975413f5548c3881ec3c868295836"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ac5975413f5548c3881ec3c868295836"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ac5975413f5548c3881ec3c868295836", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ac5975413f5548c3881ec3c868295836"}]}] May 23 12:45:09.523646 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant: tempest-TestVolumeBootPattern-1357796398 May 23 12:45:09.523646 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Id: ac5975413f5548c3881ec3c868295836 May 23 12:45:09.523646 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Name: tempest-TestVolumeBootPattern-1357796398 May 23 12:45:09.523646 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User: tempest-TestVolumeBootPattern-1357796398-project May 23 12:45:09.523646 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Id: default May 23 12:45:09.523646 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Name: Default May 23 12:45:09.523646 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Id: 024cf85a89d445ff854fede06d0f9244 May 23 12:45:09.523646 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Name: tempest-TestVolumeBootPattern-1357796398-project May 23 12:45:09.523646 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: method: > May 23 12:45:09.523646 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: exception: Instance 0ec9234d-3bbf-4d1f-8780-5544e03fe111 could not be found. May 23 12:45:09.523646 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: action_args: {'id': '0ec9234d-3bbf-4d1f-8780-5544e03fe111'} May 23 12:45:09.525024 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:45:09.525024 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:45:09.525024 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:45:09.525024 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:45:09.525024 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:45:09.525024 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:45:09.525024 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:45:09.525024 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:45:09.525024 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:45:09.525024 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:45:09.525024 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ec9234d-3bbf-4d1f-8780-5544e03fe111 could not be found. May 23 12:45:09.525024 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:45:09.525024 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:45:09.525024 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:45:09.525024 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:45:09.525024 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:45:09.525024 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:45:09.525024 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:45:09.525024 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:45:09.525024 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:45:09.526688 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:45:09.526688 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:45:09.526688 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:45:09.526688 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:45:09.526688 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:45:09.526688 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:45:09.526688 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:45:09.526688 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ec9234d-3bbf-4d1f-8780-5544e03fe111 could not be found. May 23 12:45:09.526688 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:45:09.526688 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:45:09.526688 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:45:09.526688 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:45:09.526688 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:45:09.526688 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:45:09.526688 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:45:09.526688 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:45:09.526688 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ec9234d-3bbf-4d1f-8780-5544e03fe111 could not be found. May 23 12:45:09.526688 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:45:09.528729 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-706d5bf2-6b98-4f20-aa7d-32e1a4377a30 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Returning 404 to user: Instance 0ec9234d-3bbf-4d1f-8780-5544e03fe111 could not be found. {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:45:09.528729 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-706d5bf2-6b98-4f20-aa7d-32e1a4377a30 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111" status: 404 len: 111 microversion: 2.1 time: 0.032350 May 23 12:45:09.528729 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 501/1014] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:45:09 2022] GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:45:09.621341 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-31324122-d9fd-4b89-b662-d8a32d68ecbe tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-719884939", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-975896852", "security_groups": [{"name": "tempest-secgroup-smoke-1035934523"}], "block_device_mapping_v2": [{"uuid": "edf1264f-b5a5-4252-ab1c-19c8489f2935", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "12b22b49-c25e-4ae4-ac66-3d3f23b3684e"}]}} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:45:09.757576 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.network.neutron [None req-31324122-d9fd-4b89-b662-d8a32d68ecbe tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] validate_networks() for [('12b22b49-c25e-4ae4-ac66-3d3f23b3684e', None, None, None, None, None)] {{(pid=124200) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 12:45:10.135489 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-31324122-d9fd-4b89-b662-d8a32d68ecbe tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Flavor limits 0:0:0 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 12:45:10.135911 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-31324122-d9fd-4b89-b662-d8a32d68ecbe tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Image limits 0:0:0 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 12:45:10.136422 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-31324122-d9fd-4b89-b662-d8a32d68ecbe tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Flavor pref 0:0:0 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 12:45:10.136907 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-31324122-d9fd-4b89-b662-d8a32d68ecbe tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Image pref 0:0:0 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 12:45:10.137526 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.virt.hardware [None req-31324122-d9fd-4b89-b662-d8a32d68ecbe tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 12:45:10.146340 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-31324122-d9fd-4b89-b662-d8a32d68ecbe tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:10.146794 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-31324122-d9fd-4b89-b662-d8a32d68ecbe tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:10.147625 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-31324122-d9fd-4b89-b662-d8a32d68ecbe tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:10.148056 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-31324122-d9fd-4b89-b662-d8a32d68ecbe tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:10.165246 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.quota [None req-31324122-d9fd-4b89-b662-d8a32d68ecbe tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Getting quotas for project ac5975413f5548c3881ec3c868295836. Resources: {'instances', 'cores', 'ram'} {{(pid=124200) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:45:10.170041 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.quota [None req-31324122-d9fd-4b89-b662-d8a32d68ecbe tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Getting quotas for user 024cf85a89d445ff854fede06d0f9244 and project ac5975413f5548c3881ec3c868295836. Resources: {'instances', 'cores', 'ram'} {{(pid=124200) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:45:10.235224 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-31324122-d9fd-4b89-b662-d8a32d68ecbe tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Going to run 1 instances... {{(pid=124200) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 12:45:10.239117 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-31324122-d9fd-4b89-b662-d8a32d68ecbe tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 78e5c6e8-06cd-469c-98b9-f36b067796f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='edf1264f-b5a5-4252-ab1c-19c8489f2935',volume_size=None,volume_type=None)] {{(pid=124200) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 12:45:10.381847 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-31324122-d9fd-4b89-b662-d8a32d68ecbe tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.764717 May 23 12:45:10.382763 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 514/1015] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 23 12:45:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 12:45:10.393321 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c6fe7470-c6f3-4480-b5f2-0acef7a606f2 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:45:10.394000 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c6fe7470-c6f3-4480-b5f2-0acef7a606f2 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 78e5c6e8-06cd-469c-98b9-f36b067796f2] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:45:10.463071 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c6fe7470-c6f3-4480-b5f2-0acef7a606f2 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:45:10.470685 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c6fe7470-c6f3-4480-b5f2-0acef7a606f2 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/78e5c6e8-06cd-469c-98b9-f36b067796f2" status: 200 len: 1093 microversion: 2.1 time: 0.081292 May 23 12:45:10.471251 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 502/1016] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:45:10 2022] GET /compute/v2.1/servers/78e5c6e8-06cd-469c-98b9-f36b067796f2 => generated 1093 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:45:10.658962 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 12:45:10.659139 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Mon May 23 12:45:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 12:45:11.487956 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-b5afa061-7890-4770-b9e1-77cb07276f0e tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:45:11.489722 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-b5afa061-7890-4770-b9e1-77cb07276f0e tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 78e5c6e8-06cd-469c-98b9-f36b067796f2] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:45:11.498042 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b5afa061-7890-4770-b9e1-77cb07276f0e tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:11.498505 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b5afa061-7890-4770-b9e1-77cb07276f0e tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:11.499304 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b5afa061-7890-4770-b9e1-77cb07276f0e tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:11.499839 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b5afa061-7890-4770-b9e1-77cb07276f0e tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:11.592609 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-b5afa061-7890-4770-b9e1-77cb07276f0e tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:45:11.601038 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-b5afa061-7890-4770-b9e1-77cb07276f0e tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/78e5c6e8-06cd-469c-98b9-f36b067796f2" status: 200 len: 1209 microversion: 2.1 time: 0.117654 May 23 12:45:11.601605 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 515/1017] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:45:11 2022] GET /compute/v2.1/servers/78e5c6e8-06cd-469c-98b9-f36b067796f2 => generated 1209 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:45:12.625913 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-9ca69a1a-3562-43b2-8c86-e03a77c2da0e tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:45:12.627619 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-9ca69a1a-3562-43b2-8c86-e03a77c2da0e tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 78e5c6e8-06cd-469c-98b9-f36b067796f2] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:45:12.635906 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9ca69a1a-3562-43b2-8c86-e03a77c2da0e tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:12.636740 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9ca69a1a-3562-43b2-8c86-e03a77c2da0e tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:12.637886 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9ca69a1a-3562-43b2-8c86-e03a77c2da0e tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:12.638691 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9ca69a1a-3562-43b2-8c86-e03a77c2da0e tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:12.856587 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9ca69a1a-3562-43b2-8c86-e03a77c2da0e tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:45:12.866001 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-9ca69a1a-3562-43b2-8c86-e03a77c2da0e tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/78e5c6e8-06cd-469c-98b9-f36b067796f2" status: 200 len: 1265 microversion: 2.1 time: 0.250096 May 23 12:45:12.866700 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 503/1018] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:45:12 2022] GET /compute/v2.1/servers/78e5c6e8-06cd-469c-98b9-f36b067796f2 => generated 1265 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:45:12.937929 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-e4e03a87-b5eb-41fa-a3f6-e8a168055897 req-618073ba-7ff4-47ed-8d1b-fc45ad376268 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78e5c6e8-06cd-469c-98b9-f36b067796f2", "tag": "eb2d3ef6-0647-4cc3-acdf-fa6e85c2b219"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:45:12.953593 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-e4e03a87-b5eb-41fa-a3f6-e8a168055897 req-618073ba-7ff4-47ed-8d1b-fc45ad376268 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:12.954046 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-e4e03a87-b5eb-41fa-a3f6-e8a168055897 req-618073ba-7ff4-47ed-8d1b-fc45ad376268 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:12.974000 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-e4e03a87-b5eb-41fa-a3f6-e8a168055897 req-618073ba-7ff4-47ed-8d1b-fc45ad376268 service nova] Creating event network-changed:eb2d3ef6-0647-4cc3-acdf-fa6e85c2b219 for instance 78e5c6e8-06cd-469c-98b9-f36b067796f2 on hv-cinder-83699 May 23 12:45:12.979103 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-e4e03a87-b5eb-41fa-a3f6-e8a168055897 req-618073ba-7ff4-47ed-8d1b-fc45ad376268 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046174 May 23 12:45:12.979712 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 516/1019] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:45:13.884798 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-599f1b4c-a9fa-40f3-967d-e541bcb27ea5 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:45:13.885403 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-599f1b4c-a9fa-40f3-967d-e541bcb27ea5 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 78e5c6e8-06cd-469c-98b9-f36b067796f2] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:45:13.895482 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-599f1b4c-a9fa-40f3-967d-e541bcb27ea5 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:13.895928 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-599f1b4c-a9fa-40f3-967d-e541bcb27ea5 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:13.896747 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-599f1b4c-a9fa-40f3-967d-e541bcb27ea5 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:13.897183 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-599f1b4c-a9fa-40f3-967d-e541bcb27ea5 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:14.298061 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-599f1b4c-a9fa-40f3-967d-e541bcb27ea5 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:45:14.305548 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-599f1b4c-a9fa-40f3-967d-e541bcb27ea5 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/78e5c6e8-06cd-469c-98b9-f36b067796f2" status: 200 len: 1265 microversion: 2.1 time: 0.424759 May 23 12:45:14.306117 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 504/1020] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:45:13 2022] GET /compute/v2.1/servers/78e5c6e8-06cd-469c-98b9-f36b067796f2 => generated 1265 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:45:15.324532 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-25d7da05-cf97-4582-af72-29aa04a5a66e tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:45:15.325121 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-25d7da05-cf97-4582-af72-29aa04a5a66e tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 78e5c6e8-06cd-469c-98b9-f36b067796f2] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:45:15.331963 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-25d7da05-cf97-4582-af72-29aa04a5a66e tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:15.332462 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-25d7da05-cf97-4582-af72-29aa04a5a66e tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:15.333243 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-25d7da05-cf97-4582-af72-29aa04a5a66e tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:15.333681 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-25d7da05-cf97-4582-af72-29aa04a5a66e tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:15.468410 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-25d7da05-cf97-4582-af72-29aa04a5a66e tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:45:15.476243 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-25d7da05-cf97-4582-af72-29aa04a5a66e tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/78e5c6e8-06cd-469c-98b9-f36b067796f2" status: 200 len: 1265 microversion: 2.1 time: 0.156515 May 23 12:45:15.476822 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 517/1021] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:45:15 2022] GET /compute/v2.1/servers/78e5c6e8-06cd-469c-98b9-f36b067796f2 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:45:16.492914 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-fab671c1-e736-420d-ba2e-cf8317d22839 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:45:16.493522 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-fab671c1-e736-420d-ba2e-cf8317d22839 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 78e5c6e8-06cd-469c-98b9-f36b067796f2] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:45:16.500248 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fab671c1-e736-420d-ba2e-cf8317d22839 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:16.500705 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fab671c1-e736-420d-ba2e-cf8317d22839 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:16.501483 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fab671c1-e736-420d-ba2e-cf8317d22839 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:16.502246 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fab671c1-e736-420d-ba2e-cf8317d22839 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:16.639570 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-fab671c1-e736-420d-ba2e-cf8317d22839 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:45:16.647254 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-fab671c1-e736-420d-ba2e-cf8317d22839 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/78e5c6e8-06cd-469c-98b9-f36b067796f2" status: 200 len: 1265 microversion: 2.1 time: 0.158454 May 23 12:45:16.647822 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 505/1022] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:45:16 2022] GET /compute/v2.1/servers/78e5c6e8-06cd-469c-98b9-f36b067796f2 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:45:17.664777 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-4c56e3ec-fde3-49c6-b039-8055d8890ad6 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:45:17.665380 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-4c56e3ec-fde3-49c6-b039-8055d8890ad6 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 78e5c6e8-06cd-469c-98b9-f36b067796f2] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:45:17.673010 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4c56e3ec-fde3-49c6-b039-8055d8890ad6 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:17.673461 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4c56e3ec-fde3-49c6-b039-8055d8890ad6 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:17.674235 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4c56e3ec-fde3-49c6-b039-8055d8890ad6 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:17.674667 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-4c56e3ec-fde3-49c6-b039-8055d8890ad6 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:17.812901 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-4c56e3ec-fde3-49c6-b039-8055d8890ad6 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:45:17.820477 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-4c56e3ec-fde3-49c6-b039-8055d8890ad6 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/78e5c6e8-06cd-469c-98b9-f36b067796f2" status: 200 len: 1265 microversion: 2.1 time: 0.159490 May 23 12:45:17.821047 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 518/1023] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:45:17 2022] GET /compute/v2.1/servers/78e5c6e8-06cd-469c-98b9-f36b067796f2 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:45:18.839580 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-9a4568ba-78ee-45ea-acc9-c553765152cd tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:45:18.840898 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-9a4568ba-78ee-45ea-acc9-c553765152cd tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 78e5c6e8-06cd-469c-98b9-f36b067796f2] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:45:18.848200 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9a4568ba-78ee-45ea-acc9-c553765152cd tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:18.848674 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9a4568ba-78ee-45ea-acc9-c553765152cd tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:18.849567 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9a4568ba-78ee-45ea-acc9-c553765152cd tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:18.849943 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9a4568ba-78ee-45ea-acc9-c553765152cd tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:18.993446 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9a4568ba-78ee-45ea-acc9-c553765152cd tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:45:19.001345 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-9a4568ba-78ee-45ea-acc9-c553765152cd tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/78e5c6e8-06cd-469c-98b9-f36b067796f2" status: 200 len: 1265 microversion: 2.1 time: 0.166827 May 23 12:45:19.001924 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 506/1024] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:45:18 2022] GET /compute/v2.1/servers/78e5c6e8-06cd-469c-98b9-f36b067796f2 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:45:20.018833 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-a916d643-0a07-4406-baa6-5291decce6f0 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:45:20.019360 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-a916d643-0a07-4406-baa6-5291decce6f0 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 78e5c6e8-06cd-469c-98b9-f36b067796f2] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:45:20.026260 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a916d643-0a07-4406-baa6-5291decce6f0 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:20.026710 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a916d643-0a07-4406-baa6-5291decce6f0 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:20.027501 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a916d643-0a07-4406-baa6-5291decce6f0 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:20.028586 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-a916d643-0a07-4406-baa6-5291decce6f0 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:20.155020 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell0:SELECT=2 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:45:20.163711 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-a916d643-0a07-4406-baa6-5291decce6f0 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:45:20.171346 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-a916d643-0a07-4406-baa6-5291decce6f0 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/78e5c6e8-06cd-469c-98b9-f36b067796f2" status: 200 len: 1265 microversion: 2.1 time: 0.156467 May 23 12:45:20.171920 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 519/1025] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:45:20 2022] GET /compute/v2.1/servers/78e5c6e8-06cd-469c-98b9-f36b067796f2 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:45:21.188458 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f7ccc7bb-5dc9-4d9f-bbc0-1687db512790 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:45:21.189091 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-f7ccc7bb-5dc9-4d9f-bbc0-1687db512790 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 78e5c6e8-06cd-469c-98b9-f36b067796f2] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:45:21.191473 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell0:SELECT=2 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:45:21.196735 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f7ccc7bb-5dc9-4d9f-bbc0-1687db512790 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:21.197178 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f7ccc7bb-5dc9-4d9f-bbc0-1687db512790 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:21.197950 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f7ccc7bb-5dc9-4d9f-bbc0-1687db512790 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:21.198384 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f7ccc7bb-5dc9-4d9f-bbc0-1687db512790 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:21.331526 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f7ccc7bb-5dc9-4d9f-bbc0-1687db512790 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:45:21.339166 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f7ccc7bb-5dc9-4d9f-bbc0-1687db512790 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/78e5c6e8-06cd-469c-98b9-f36b067796f2" status: 200 len: 1265 microversion: 2.1 time: 0.154985 May 23 12:45:21.339723 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 507/1026] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:45:21 2022] GET /compute/v2.1/servers/78e5c6e8-06cd-469c-98b9-f36b067796f2 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:45:22.144553 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-199782cf-678e-4dcf-9d0f-0a70a2190410 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:45:22.145507 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-199782cf-678e-4dcf-9d0f-0a70a2190410 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:45:22.147576 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell0:SELECT=6 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:45:22.153303 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-199782cf-678e-4dcf-9d0f-0a70a2190410 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:22.153756 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-199782cf-678e-4dcf-9d0f-0a70a2190410 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:22.154537 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-199782cf-678e-4dcf-9d0f-0a70a2190410 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:22.154974 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-199782cf-678e-4dcf-9d0f-0a70a2190410 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:22.234800 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-199782cf-678e-4dcf-9d0f-0a70a2190410 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "POST /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21/action" status: 202 len: 0 microversion: 2.1 time: 0.093975 May 23 12:45:22.238308 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 520/1027] 10.222.0.16 () {60 vars in 1277 bytes} [Mon May 23 12:45:22 2022] POST /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:45:22.243817 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-3ffc2e6c-8c41-4a10-909e-22ce1d85f112 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:45:22.244485 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-3ffc2e6c-8c41-4a10-909e-22ce1d85f112 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:45:22.251617 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3ffc2e6c-8c41-4a10-909e-22ce1d85f112 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:22.252263 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3ffc2e6c-8c41-4a10-909e-22ce1d85f112 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:22.253102 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3ffc2e6c-8c41-4a10-909e-22ce1d85f112 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:22.253581 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3ffc2e6c-8c41-4a10-909e-22ce1d85f112 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:22.358261 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-95dc1cf7-6793-4bca-b515-7ccdbdd7a43e tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:45:22.358965 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-95dc1cf7-6793-4bca-b515-7ccdbdd7a43e tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 78e5c6e8-06cd-469c-98b9-f36b067796f2] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:45:22.365395 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-95dc1cf7-6793-4bca-b515-7ccdbdd7a43e tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:22.365843 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-95dc1cf7-6793-4bca-b515-7ccdbdd7a43e tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:22.366615 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-95dc1cf7-6793-4bca-b515-7ccdbdd7a43e tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:22.367049 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-95dc1cf7-6793-4bca-b515-7ccdbdd7a43e tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:22.555871 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-3ffc2e6c-8c41-4a10-909e-22ce1d85f112 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9f4184defc406e8fd753eac219341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51a0c52de248fdb85a7cee23739b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:45:22.564562 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-3ffc2e6c-8c41-4a10-909e-22ce1d85f112 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21" status: 200 len: 1752 microversion: 2.1 time: 0.324396 May 23 12:45:22.575341 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 508/1028] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:45:22 2022] GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21 => generated 1752 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:45:22.625632 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-95dc1cf7-6793-4bca-b515-7ccdbdd7a43e tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:45:22.633563 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-95dc1cf7-6793-4bca-b515-7ccdbdd7a43e tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/78e5c6e8-06cd-469c-98b9-f36b067796f2" status: 200 len: 1265 microversion: 2.1 time: 0.280591 May 23 12:45:22.634471 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 521/1029] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:45:22 2022] GET /compute/v2.1/servers/78e5c6e8-06cd-469c-98b9-f36b067796f2 => generated 1265 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:45:23.583410 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-5717766a-4276-4982-afc2-30e99f6d983e tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:45:23.584060 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-5717766a-4276-4982-afc2-30e99f6d983e tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:45:23.590832 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5717766a-4276-4982-afc2-30e99f6d983e tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:23.591293 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5717766a-4276-4982-afc2-30e99f6d983e tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:23.592082 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5717766a-4276-4982-afc2-30e99f6d983e tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:23.592543 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5717766a-4276-4982-afc2-30e99f6d983e tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:23.650656 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-b80800e5-d677-49a8-8e98-35e31446d887 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:45:23.651266 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-b80800e5-d677-49a8-8e98-35e31446d887 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 78e5c6e8-06cd-469c-98b9-f36b067796f2] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:45:23.658804 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b80800e5-d677-49a8-8e98-35e31446d887 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:23.659247 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b80800e5-d677-49a8-8e98-35e31446d887 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:23.660025 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b80800e5-d677-49a8-8e98-35e31446d887 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:23.660557 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b80800e5-d677-49a8-8e98-35e31446d887 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:23.798466 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-5717766a-4276-4982-afc2-30e99f6d983e tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9f4184defc406e8fd753eac219341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51a0c52de248fdb85a7cee23739b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:45:23.806716 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-5717766a-4276-4982-afc2-30e99f6d983e tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21" status: 200 len: 1757 microversion: 2.1 time: 0.227396 May 23 12:45:23.807298 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 509/1030] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:45:23 2022] GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21 => generated 1757 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:45:23.834894 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-b80800e5-d677-49a8-8e98-35e31446d887 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:45:23.842678 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-b80800e5-d677-49a8-8e98-35e31446d887 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/78e5c6e8-06cd-469c-98b9-f36b067796f2" status: 200 len: 1265 microversion: 2.1 time: 0.195908 May 23 12:45:23.843253 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 522/1031] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:45:23 2022] GET /compute/v2.1/servers/78e5c6e8-06cd-469c-98b9-f36b067796f2 => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:45:24.684257 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-f7585c8c-4d7b-46b1-82f8-c538a2c3952c req-9d40bc25-065d-44db-b717-e3918fc8a4b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78e5c6e8-06cd-469c-98b9-f36b067796f2", "name": "network-vif-plugged", "status": "completed", "tag": "eb2d3ef6-0647-4cc3-acdf-fa6e85c2b219"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:45:24.694304 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-f7585c8c-4d7b-46b1-82f8-c538a2c3952c req-9d40bc25-065d-44db-b717-e3918fc8a4b9 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:24.694820 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-f7585c8c-4d7b-46b1-82f8-c538a2c3952c req-9d40bc25-065d-44db-b717-e3918fc8a4b9 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:24.709037 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-f7585c8c-4d7b-46b1-82f8-c538a2c3952c req-9d40bc25-065d-44db-b717-e3918fc8a4b9 service nova] Creating event network-vif-plugged:eb2d3ef6-0647-4cc3-acdf-fa6e85c2b219 for instance 78e5c6e8-06cd-469c-98b9-f36b067796f2 on hv-cinder-83699 May 23 12:45:24.714018 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-f7585c8c-4d7b-46b1-82f8-c538a2c3952c req-9d40bc25-065d-44db-b717-e3918fc8a4b9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034113 May 23 12:45:24.715050 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 510/1032] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:45:24.827221 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-ad6fb2c6-d383-4d39-91ee-f73a7b2ed167 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:45:24.828315 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-ad6fb2c6-d383-4d39-91ee-f73a7b2ed167 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:45:24.836458 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ad6fb2c6-d383-4d39-91ee-f73a7b2ed167 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:24.836903 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ad6fb2c6-d383-4d39-91ee-f73a7b2ed167 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:24.837679 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ad6fb2c6-d383-4d39-91ee-f73a7b2ed167 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:24.838113 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ad6fb2c6-d383-4d39-91ee-f73a7b2ed167 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:24.861859 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-55932bec-ba62-4f71-b5ae-e0fb5bdf5ca9 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:45:24.862953 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-55932bec-ba62-4f71-b5ae-e0fb5bdf5ca9 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 78e5c6e8-06cd-469c-98b9-f36b067796f2] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:45:24.870859 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-55932bec-ba62-4f71-b5ae-e0fb5bdf5ca9 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:24.871832 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-55932bec-ba62-4f71-b5ae-e0fb5bdf5ca9 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:24.872787 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-55932bec-ba62-4f71-b5ae-e0fb5bdf5ca9 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:24.873817 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-55932bec-ba62-4f71-b5ae-e0fb5bdf5ca9 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:25.137757 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-55932bec-ba62-4f71-b5ae-e0fb5bdf5ca9 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:45:25.143846 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-ad6fb2c6-d383-4d39-91ee-f73a7b2ed167 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9f4184defc406e8fd753eac219341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51a0c52de248fdb85a7cee23739b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:45:25.145547 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-55932bec-ba62-4f71-b5ae-e0fb5bdf5ca9 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/78e5c6e8-06cd-469c-98b9-f36b067796f2" status: 200 len: 1265 microversion: 2.1 time: 0.290415 May 23 12:45:25.146325 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 511/1033] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:45:24 2022] GET /compute/v2.1/servers/78e5c6e8-06cd-469c-98b9-f36b067796f2 => generated 1265 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:45:25.152349 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-ad6fb2c6-d383-4d39-91ee-f73a7b2ed167 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21" status: 200 len: 1757 microversion: 2.1 time: 0.330664 May 23 12:45:25.153187 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 523/1034] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:45:24 2022] GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21 => generated 1757 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:45:26.171767 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-bda737f9-35c5-4885-8e11-ca2c56f494c4 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:45:26.172743 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-bda737f9-35c5-4885-8e11-ca2c56f494c4 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:45:26.179072 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c5c51d64-4b69-4249-bb23-1bd488fd5af5 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:45:26.179683 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c5c51d64-4b69-4249-bb23-1bd488fd5af5 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 78e5c6e8-06cd-469c-98b9-f36b067796f2] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:45:26.186347 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-bda737f9-35c5-4885-8e11-ca2c56f494c4 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:26.186711 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c5c51d64-4b69-4249-bb23-1bd488fd5af5 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:26.186891 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-bda737f9-35c5-4885-8e11-ca2c56f494c4 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:26.187160 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c5c51d64-4b69-4249-bb23-1bd488fd5af5 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:26.187554 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-bda737f9-35c5-4885-8e11-ca2c56f494c4 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:26.187966 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c5c51d64-4b69-4249-bb23-1bd488fd5af5 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:26.188183 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-bda737f9-35c5-4885-8e11-ca2c56f494c4 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:26.188425 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c5c51d64-4b69-4249-bb23-1bd488fd5af5 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:26.399340 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c5c51d64-4b69-4249-bb23-1bd488fd5af5 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:45:26.405894 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-bda737f9-35c5-4885-8e11-ca2c56f494c4 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9f4184defc406e8fd753eac219341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51a0c52de248fdb85a7cee23739b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:45:26.408338 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c5c51d64-4b69-4249-bb23-1bd488fd5af5 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/78e5c6e8-06cd-469c-98b9-f36b067796f2" status: 200 len: 1453 microversion: 2.1 time: 0.243659 May 23 12:45:26.409303 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 512/1035] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:45:26 2022] GET /compute/v2.1/servers/78e5c6e8-06cd-469c-98b9-f36b067796f2 => generated 1453 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:45:26.414242 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-bda737f9-35c5-4885-8e11-ca2c56f494c4 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21" status: 200 len: 1757 microversion: 2.1 time: 0.247663 May 23 12:45:26.414818 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 524/1036] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:45:26 2022] GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21 => generated 1757 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:45:26.425421 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-aad71ec2-3f11-4dd1-91a2-5e2f74224135 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:45:26.426066 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-aad71ec2-3f11-4dd1-91a2-5e2f74224135 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 78e5c6e8-06cd-469c-98b9-f36b067796f2] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:45:26.432228 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-aad71ec2-3f11-4dd1-91a2-5e2f74224135 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:26.432689 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-aad71ec2-3f11-4dd1-91a2-5e2f74224135 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:26.433470 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-aad71ec2-3f11-4dd1-91a2-5e2f74224135 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:26.433969 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-aad71ec2-3f11-4dd1-91a2-5e2f74224135 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:26.573408 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-aad71ec2-3f11-4dd1-91a2-5e2f74224135 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:45:26.581913 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-aad71ec2-3f11-4dd1-91a2-5e2f74224135 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/78e5c6e8-06cd-469c-98b9-f36b067796f2" status: 200 len: 1453 microversion: 2.1 time: 0.160513 May 23 12:45:26.582487 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 513/1037] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:45:26 2022] GET /compute/v2.1/servers/78e5c6e8-06cd-469c-98b9-f36b067796f2 => generated 1453 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:45:27.432214 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-8e3ca86a-3a05-4283-a5cd-39941ec99846 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:45:27.432856 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-8e3ca86a-3a05-4283-a5cd-39941ec99846 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:45:27.441614 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8e3ca86a-3a05-4283-a5cd-39941ec99846 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:27.442061 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8e3ca86a-3a05-4283-a5cd-39941ec99846 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:27.442833 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8e3ca86a-3a05-4283-a5cd-39941ec99846 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:27.443266 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8e3ca86a-3a05-4283-a5cd-39941ec99846 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:27.703069 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-8e3ca86a-3a05-4283-a5cd-39941ec99846 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9f4184defc406e8fd753eac219341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51a0c52de248fdb85a7cee23739b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:45:27.711504 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-8e3ca86a-3a05-4283-a5cd-39941ec99846 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21" status: 200 len: 1757 microversion: 2.1 time: 0.283309 May 23 12:45:27.712092 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 525/1038] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:45:27 2022] GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21 => generated 1757 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:45:28.348868 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-115867fe-a650-4283-b53c-4ada91bdb482 req-726e5b12-5af9-46f8-8cad-f174c4a691b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78e5c6e8-06cd-469c-98b9-f36b067796f2", "tag": "eb2d3ef6-0647-4cc3-acdf-fa6e85c2b219"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:45:28.359161 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-115867fe-a650-4283-b53c-4ada91bdb482 req-726e5b12-5af9-46f8-8cad-f174c4a691b4 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:28.359602 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-115867fe-a650-4283-b53c-4ada91bdb482 req-726e5b12-5af9-46f8-8cad-f174c4a691b4 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:28.371082 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-115867fe-a650-4283-b53c-4ada91bdb482 req-726e5b12-5af9-46f8-8cad-f174c4a691b4 service nova] Creating event network-changed:eb2d3ef6-0647-4cc3-acdf-fa6e85c2b219 for instance 78e5c6e8-06cd-469c-98b9-f36b067796f2 on hv-cinder-83699 May 23 12:45:28.376516 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-115867fe-a650-4283-b53c-4ada91bdb482 req-726e5b12-5af9-46f8-8cad-f174c4a691b4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031806 May 23 12:45:28.377171 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 514/1039] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:45:28.733041 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-169923c0-b10e-492e-9744-ad376b68c43d tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:45:28.734255 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-169923c0-b10e-492e-9744-ad376b68c43d tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:45:28.742258 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-169923c0-b10e-492e-9744-ad376b68c43d tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:28.742717 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-169923c0-b10e-492e-9744-ad376b68c43d tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:28.743559 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-169923c0-b10e-492e-9744-ad376b68c43d tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:28.744004 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-169923c0-b10e-492e-9744-ad376b68c43d tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:28.747117 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:45:28.986276 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-169923c0-b10e-492e-9744-ad376b68c43d tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9f4184defc406e8fd753eac219341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51a0c52de248fdb85a7cee23739b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:45:28.995236 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-169923c0-b10e-492e-9744-ad376b68c43d tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21" status: 200 len: 1757 microversion: 2.1 time: 0.267958 May 23 12:45:28.995985 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 526/1040] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:45:28 2022] GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21 => generated 1757 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:45:30.015519 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-990bb980-9dd2-420f-814f-030994b14c45 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:45:30.016137 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-990bb980-9dd2-420f-814f-030994b14c45 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:45:30.018116 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_api:SELECT=38 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:45:30.024154 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-990bb980-9dd2-420f-814f-030994b14c45 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:30.024626 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-990bb980-9dd2-420f-814f-030994b14c45 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:30.025418 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-990bb980-9dd2-420f-814f-030994b14c45 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:30.025859 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-990bb980-9dd2-420f-814f-030994b14c45 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:30.029493 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell1:SELECT=86 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:45:30.177435 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-990bb980-9dd2-420f-814f-030994b14c45 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9f4184defc406e8fd753eac219341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51a0c52de248fdb85a7cee23739b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:45:30.186470 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-990bb980-9dd2-420f-814f-030994b14c45 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21" status: 200 len: 1757 microversion: 2.1 time: 0.177081 May 23 12:45:30.187052 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 515/1041] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:45:30 2022] GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21 => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:45:31.204506 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-02e48abe-e534-4792-9ca4-1a73d9322c4f tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:45:31.205114 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-02e48abe-e534-4792-9ca4-1a73d9322c4f tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:45:31.207783 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:45:31.213143 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-02e48abe-e534-4792-9ca4-1a73d9322c4f tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:31.213593 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-02e48abe-e534-4792-9ca4-1a73d9322c4f tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:31.214365 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-02e48abe-e534-4792-9ca4-1a73d9322c4f tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:31.215457 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-02e48abe-e534-4792-9ca4-1a73d9322c4f tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:31.367668 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-02e48abe-e534-4792-9ca4-1a73d9322c4f tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9f4184defc406e8fd753eac219341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51a0c52de248fdb85a7cee23739b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:45:31.376402 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-02e48abe-e534-4792-9ca4-1a73d9322c4f tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21" status: 200 len: 1757 microversion: 2.1 time: 0.175846 May 23 12:45:31.376982 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 527/1042] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:45:31 2022] GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21 => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:45:32.394744 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-9ee1781a-5f13-4877-9cb0-006cc96a6e47 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:45:32.395550 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-9ee1781a-5f13-4877-9cb0-006cc96a6e47 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:45:32.403027 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9ee1781a-5f13-4877-9cb0-006cc96a6e47 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:32.403472 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9ee1781a-5f13-4877-9cb0-006cc96a6e47 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:32.404275 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9ee1781a-5f13-4877-9cb0-006cc96a6e47 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:32.404707 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9ee1781a-5f13-4877-9cb0-006cc96a6e47 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:32.556139 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9ee1781a-5f13-4877-9cb0-006cc96a6e47 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9f4184defc406e8fd753eac219341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51a0c52de248fdb85a7cee23739b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:45:32.564332 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-9ee1781a-5f13-4877-9cb0-006cc96a6e47 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21" status: 200 len: 1757 microversion: 2.1 time: 0.174307 May 23 12:45:32.564912 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 516/1043] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:45:32 2022] GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21 => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:45:33.581886 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-715cd39b-e177-4a07-a495-81d0c4e97fff tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:45:33.582480 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-715cd39b-e177-4a07-a495-81d0c4e97fff tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:45:33.589078 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-715cd39b-e177-4a07-a495-81d0c4e97fff tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:33.589544 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-715cd39b-e177-4a07-a495-81d0c4e97fff tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:33.590485 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-715cd39b-e177-4a07-a495-81d0c4e97fff tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:33.590927 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-715cd39b-e177-4a07-a495-81d0c4e97fff tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:33.746476 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-715cd39b-e177-4a07-a495-81d0c4e97fff tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9f4184defc406e8fd753eac219341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51a0c52de248fdb85a7cee23739b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:45:33.758055 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-715cd39b-e177-4a07-a495-81d0c4e97fff tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21" status: 200 len: 1757 microversion: 2.1 time: 0.180285 May 23 12:45:33.758648 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 528/1044] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:45:33 2022] GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21 => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:45:34.774905 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-cd1e9037-ee53-4d8d-b829-92519f0f7d22 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:45:34.775543 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-cd1e9037-ee53-4d8d-b829-92519f0f7d22 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:45:34.782376 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cd1e9037-ee53-4d8d-b829-92519f0f7d22 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:34.782824 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cd1e9037-ee53-4d8d-b829-92519f0f7d22 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:34.783608 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cd1e9037-ee53-4d8d-b829-92519f0f7d22 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:34.784045 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cd1e9037-ee53-4d8d-b829-92519f0f7d22 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:34.937195 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-cd1e9037-ee53-4d8d-b829-92519f0f7d22 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9f4184defc406e8fd753eac219341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51a0c52de248fdb85a7cee23739b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:45:34.945585 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-cd1e9037-ee53-4d8d-b829-92519f0f7d22 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21" status: 200 len: 1757 microversion: 2.1 time: 0.174551 May 23 12:45:34.946160 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 517/1045] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:45:34 2022] GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21 => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:45:35.963033 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-91685fab-b291-4bfd-8026-352bbcfa73d4 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:45:35.963700 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-91685fab-b291-4bfd-8026-352bbcfa73d4 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:45:35.971467 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-91685fab-b291-4bfd-8026-352bbcfa73d4 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:35.971889 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-91685fab-b291-4bfd-8026-352bbcfa73d4 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:35.972887 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-91685fab-b291-4bfd-8026-352bbcfa73d4 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:35.973699 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-91685fab-b291-4bfd-8026-352bbcfa73d4 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:36.470999 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-91685fab-b291-4bfd-8026-352bbcfa73d4 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9f4184defc406e8fd753eac219341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51a0c52de248fdb85a7cee23739b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:45:36.479459 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-91685fab-b291-4bfd-8026-352bbcfa73d4 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21" status: 200 len: 1757 microversion: 2.1 time: 0.520372 May 23 12:45:36.480039 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 529/1046] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:45:35 2022] GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21 => generated 1757 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:45:37.500029 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-da89a414-743e-455c-954c-b79525f6e072 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:45:37.501216 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-da89a414-743e-455c-954c-b79525f6e072 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:45:37.507889 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-da89a414-743e-455c-954c-b79525f6e072 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:37.508384 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-da89a414-743e-455c-954c-b79525f6e072 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:37.509293 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-da89a414-743e-455c-954c-b79525f6e072 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:37.509733 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-da89a414-743e-455c-954c-b79525f6e072 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:37.662626 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-da89a414-743e-455c-954c-b79525f6e072 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9f4184defc406e8fd753eac219341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51a0c52de248fdb85a7cee23739b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:45:37.671742 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-da89a414-743e-455c-954c-b79525f6e072 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21" status: 200 len: 1757 microversion: 2.1 time: 0.178346 May 23 12:45:37.672365 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 518/1047] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:45:37 2022] GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21 => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:45:38.689915 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-14817d8f-db1d-4870-8711-116376b942a7 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:45:38.690510 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-14817d8f-db1d-4870-8711-116376b942a7 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:45:38.697190 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-14817d8f-db1d-4870-8711-116376b942a7 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:38.697651 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-14817d8f-db1d-4870-8711-116376b942a7 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:38.698434 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-14817d8f-db1d-4870-8711-116376b942a7 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:38.698889 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-14817d8f-db1d-4870-8711-116376b942a7 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:38.856417 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-14817d8f-db1d-4870-8711-116376b942a7 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9f4184defc406e8fd753eac219341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51a0c52de248fdb85a7cee23739b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:45:38.869210 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-14817d8f-db1d-4870-8711-116376b942a7 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21" status: 200 len: 1757 microversion: 2.1 time: 0.183370 May 23 12:45:38.869843 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 530/1048] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:45:38 2022] GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21 => generated 1757 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:45:39.887562 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-6b45b5d2-efba-4291-9834-205c6843f357 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:45:39.888258 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-6b45b5d2-efba-4291-9834-205c6843f357 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:45:39.894803 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6b45b5d2-efba-4291-9834-205c6843f357 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:39.895257 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6b45b5d2-efba-4291-9834-205c6843f357 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:39.896023 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6b45b5d2-efba-4291-9834-205c6843f357 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:39.896487 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6b45b5d2-efba-4291-9834-205c6843f357 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:40.041628 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-6b45b5d2-efba-4291-9834-205c6843f357 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9f4184defc406e8fd753eac219341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51a0c52de248fdb85a7cee23739b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:45:40.050760 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-6b45b5d2-efba-4291-9834-205c6843f357 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21" status: 200 len: 1760 microversion: 2.1 time: 0.167726 May 23 12:45:40.051337 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 519/1049] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:45:39 2022] GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21 => generated 1760 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:46:13.314357 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-99271fd1-f130-4cbe-8cfb-3c36181f5464 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1587278546"}} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:46:13.314944 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-99271fd1-f130-4cbe-8cfb-3c36181f5464 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:46:13.316983 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_api:SELECT=7 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:46:13.317648 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell1:SELECT=29 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:46:13.323124 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-99271fd1-f130-4cbe-8cfb-3c36181f5464 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:46:13.323574 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-99271fd1-f130-4cbe-8cfb-3c36181f5464 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:46:13.324383 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-99271fd1-f130-4cbe-8cfb-3c36181f5464 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:46:13.325008 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-99271fd1-f130-4cbe-8cfb-3c36181f5464 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:46:13.456296 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.network.security_group_api [None req-99271fd1-f130-4cbe-8cfb-3c36181f5464 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Removing security group ceed8677-b38c-433b-96d9-aa6717e80a39 from port 45b3dda8-fb5f-4e14-8992-d8f97790fbdc May 23 12:46:13.837742 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-99271fd1-f130-4cbe-8cfb-3c36181f5464 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "POST /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21/action" status: 202 len: 0 microversion: 2.1 time: 0.528315 May 23 12:46:13.842417 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 531/1050] 10.222.0.16 () {60 vars in 1277 bytes} [Mon May 23 12:46:13 2022] POST /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21/action => generated 0 bytes in 530 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:46:13.847902 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-a09b353c-ca87-4399-9471-28a4fb743600 req-b781ae60-22c6-43d8-859e-1620d9750e69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f66733e1-e43c-4011-b271-ef705a2a9b21", "tag": "45b3dda8-fb5f-4e14-8992-d8f97790fbdc"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:46:13.857890 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_api:SELECT=9 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:46:13.859307 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell1:SELECT=29 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:46:13.862430 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-a09b353c-ca87-4399-9471-28a4fb743600 req-b781ae60-22c6-43d8-859e-1620d9750e69 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:46:13.864870 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-a09b353c-ca87-4399-9471-28a4fb743600 req-b781ae60-22c6-43d8-859e-1620d9750e69 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:46:13.896864 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-a09b353c-ca87-4399-9471-28a4fb743600 req-b781ae60-22c6-43d8-859e-1620d9750e69 service nova] Creating event network-changed:45b3dda8-fb5f-4e14-8992-d8f97790fbdc for instance f66733e1-e43c-4011-b271-ef705a2a9b21 on hv-cinder-83699 May 23 12:46:13.904007 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-a09b353c-ca87-4399-9471-28a4fb743600 req-b781ae60-22c6-43d8-859e-1620d9750e69 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059529 May 23 12:46:13.905759 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 520/1051] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:46:14.941313 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-6ff19973-87fc-4b1b-82e9-5965c4e6abf6 req-0805c31c-c3c5-497d-b243-25f61ab23d3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f66733e1-e43c-4011-b271-ef705a2a9b21", "tag": "45b3dda8-fb5f-4e14-8992-d8f97790fbdc"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:46:14.946735 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-7ee6e74e-78c9-4aae-8224-1aa226b9266f tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:46:14.947237 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-7ee6e74e-78c9-4aae-8224-1aa226b9266f tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:46:14.954535 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7ee6e74e-78c9-4aae-8224-1aa226b9266f tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:46:14.955178 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7ee6e74e-78c9-4aae-8224-1aa226b9266f tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:46:14.956244 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7ee6e74e-78c9-4aae-8224-1aa226b9266f tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:46:14.957130 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-7ee6e74e-78c9-4aae-8224-1aa226b9266f tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:46:14.958869 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-6ff19973-87fc-4b1b-82e9-5965c4e6abf6 req-0805c31c-c3c5-497d-b243-25f61ab23d3b service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:46:14.959323 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-6ff19973-87fc-4b1b-82e9-5965c4e6abf6 req-0805c31c-c3c5-497d-b243-25f61ab23d3b service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:46:14.971518 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-6ff19973-87fc-4b1b-82e9-5965c4e6abf6 req-0805c31c-c3c5-497d-b243-25f61ab23d3b service nova] Creating event network-changed:45b3dda8-fb5f-4e14-8992-d8f97790fbdc for instance f66733e1-e43c-4011-b271-ef705a2a9b21 on hv-cinder-83699 May 23 12:46:14.976700 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-6ff19973-87fc-4b1b-82e9-5965c4e6abf6 req-0805c31c-c3c5-497d-b243-25f61ab23d3b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040983 May 23 12:46:14.977700 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 521/1052] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:46:15.043198 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.objects.instance [None req-7ee6e74e-78c9-4aae-8224-1aa226b9266f tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lazy-loading 'services' on Instance uuid f66733e1-e43c-4011-b271-ef705a2a9b21 {{(pid=124200) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:46:15.130765 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-7ee6e74e-78c9-4aae-8224-1aa226b9266f tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21/os-volume_attachments/bd587643-88ef-4751-9669-58b708f9af4a" status: 202 len: 0 microversion: 2.1 time: 0.197431 May 23 12:46:15.131931 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 532/1053] 10.222.0.16 () {58 vars in 1415 bytes} [Mon May 23 12:46:14 2022] DELETE /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21/os-volume_attachments/bd587643-88ef-4751-9669-58b708f9af4a => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:46:15.148250 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-ca4d93f6-60db-43b9-a470-1a4662fd2721 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:46:15.153201 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-ca4d93f6-60db-43b9-a470-1a4662fd2721 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:46:15.163456 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ca4d93f6-60db-43b9-a470-1a4662fd2721 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:46:15.163930 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ca4d93f6-60db-43b9-a470-1a4662fd2721 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:46:15.164732 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ca4d93f6-60db-43b9-a470-1a4662fd2721 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:46:15.165171 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ca4d93f6-60db-43b9-a470-1a4662fd2721 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:46:15.204645 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-ca4d93f6-60db-43b9-a470-1a4662fd2721 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066460 May 23 12:46:15.209192 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 522/1054] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 12:46:15 2022] GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:46:16.217864 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-af47c09c-206c-458e-b60b-748ed81ed8e9 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:46:16.218833 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-af47c09c-206c-458e-b60b-748ed81ed8e9 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:46:16.225465 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-af47c09c-206c-458e-b60b-748ed81ed8e9 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:46:16.225917 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-af47c09c-206c-458e-b60b-748ed81ed8e9 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:46:16.226672 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-af47c09c-206c-458e-b60b-748ed81ed8e9 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:46:16.227100 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-af47c09c-206c-458e-b60b-748ed81ed8e9 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:46:16.256014 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-af47c09c-206c-458e-b60b-748ed81ed8e9 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042992 May 23 12:46:16.256621 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 533/1055] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 12:46:16 2022] GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 12:46:16.266379 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-7801c8c9-85d9-4958-854b-4acecea22827 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:46:16.266910 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-7801c8c9-85d9-4958-854b-4acecea22827 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:46:16.273445 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7801c8c9-85d9-4958-854b-4acecea22827 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:46:16.273900 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7801c8c9-85d9-4958-854b-4acecea22827 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:46:16.274676 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7801c8c9-85d9-4958-854b-4acecea22827 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:46:16.275123 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7801c8c9-85d9-4958-854b-4acecea22827 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:46:16.354055 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.wsgi [None req-7801c8c9-85d9-4958-854b-4acecea22827 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] HTTP exception thrown: Instance f66733e1-e43c-4011-b271-ef705a2a9b21 is not attached to volume bd587643-88ef-4751-9669-58b708f9af4a May 23 12:46:16.357158 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-7801c8c9-85d9-4958-854b-4acecea22827 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Request method failure captured: May 23 12:46:16.357158 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: request: DELETE /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21/os-volume_attachments/bd587643-88ef-4751-9669-58b708f9af4a HTTP/1.1 May 23 12:46:16.357158 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept: application/json May 23 12:46:16.357158 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept-Encoding: identity May 23 12:46:16.357158 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Connection: close May 23 12:46:16.357158 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Length: 0 May 23 12:46:16.357158 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Type: application/json May 23 12:46:16.357158 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Host: 10.222.0.16 May 23 12:46:16.357158 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Openstack-System-Scope: None May 23 12:46:16.357158 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: User-Agent: python-urllib3/1.26.9 May 23 12:46:16.357158 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Auth-Token: gAAAAABii4GcbiTja8RmfDDyUNd-vfa-GTSnOOzIq1EOhaTbRsHS_UrVd5XHYxTWidbHwofBW3fU70wZUQZrn_sjrm-EX2pxrQgVTXio8C3ZOjORArFVTLS7NRUQX32yNeTJfJBKN_KamWVnNH-xBKPVdKzjUDdELlVoeJFge9lITLc-D90S8ac May 23 12:46:16.357158 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Id: None May 23 12:46:16.357158 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Name: None May 23 12:46:16.357158 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Identity-Status: Confirmed May 23 12:46:16.357158 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Is-Admin-Project: True May 23 12:46:16.357158 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Id: default May 23 12:46:16.357158 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Name: Default May 23 12:46:16.357158 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Id: cf51a0c52de248fdb85a7cee23739b4e May 23 12:46:16.357158 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Name: tempest-TestMinimumBasicScenario-1519055551 May 23 12:46:16.357158 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Role: member,reader May 23 12:46:16.357158 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Roles: member,reader May 23 12:46:16.358949 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf51a0c52de248fdb85a7cee23739b4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf51a0c52de248fdb85a7cee23739b4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cf51a0c52de248fdb85a7cee23739b4e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cf51a0c52de248fdb85a7cee23739b4e"}]}] May 23 12:46:16.358949 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant: tempest-TestMinimumBasicScenario-1519055551 May 23 12:46:16.358949 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Id: cf51a0c52de248fdb85a7cee23739b4e May 23 12:46:16.358949 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1519055551 May 23 12:46:16.358949 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User: tempest-TestMinimumBasicScenario-1519055551-project May 23 12:46:16.358949 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Id: default May 23 12:46:16.358949 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Name: Default May 23 12:46:16.358949 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Id: fd9f4184defc406e8fd753eac219341a May 23 12:46:16.358949 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Name: tempest-TestMinimumBasicScenario-1519055551-project May 23 12:46:16.358949 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: method: > May 23 12:46:16.358949 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: exception: Instance f66733e1-e43c-4011-b271-ef705a2a9b21 is not attached to volume bd587643-88ef-4751-9669-58b708f9af4a May 23 12:46:16.360361 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: action_args: {'server_id': 'f66733e1-e43c-4011-b271-ef705a2a9b21', 'id': 'bd587643-88ef-4751-9669-58b708f9af4a'} May 23 12:46:16.360361 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:46:16.360361 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:46:16.360361 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 23 12:46:16.360361 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 23 12:46:16.360361 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 12:46:16.360361 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 12:46:16.360361 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 23 12:46:16.360361 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 23 12:46:16.360361 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id bd587643-88ef-4751-9669-58b708f9af4a. May 23 12:46:16.360361 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:46:16.360361 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:46:16.360361 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:46:16.360361 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:46:16.360361 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:46:16.360361 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:46:16.360361 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:46:16.360361 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:46:16.360361 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:46:16.362734 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:46:16.362734 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 23 12:46:16.362734 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 23 12:46:16.362734 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f66733e1-e43c-4011-b271-ef705a2a9b21 is not attached to volume bd587643-88ef-4751-9669-58b708f9af4a May 23 12:46:16.362734 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:46:16.362734 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:46:16.362734 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:46:16.362734 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:46:16.362734 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:46:16.362734 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:46:16.362734 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:46:16.362734 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:46:16.362734 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f66733e1-e43c-4011-b271-ef705a2a9b21 is not attached to volume bd587643-88ef-4751-9669-58b708f9af4a May 23 12:46:16.362734 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:46:16.362734 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-7801c8c9-85d9-4958-854b-4acecea22827 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Returning 404 to user: Instance f66733e1-e43c-4011-b271-ef705a2a9b21 is not attached to volume bd587643-88ef-4751-9669-58b708f9af4a {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:46:16.364694 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-7801c8c9-85d9-4958-854b-4acecea22827 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21/os-volume_attachments/bd587643-88ef-4751-9669-58b708f9af4a" status: 404 len: 154 microversion: 2.1 time: 0.096194 May 23 12:46:16.364694 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 523/1056] 10.222.0.16 () {58 vars in 1415 bytes} [Mon May 23 12:46:16 2022] DELETE /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21/os-volume_attachments/bd587643-88ef-4751-9669-58b708f9af4a => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:46:17.502530 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-5cc6b9b6-06a3-4cc0-ad5d-d29be5fbd1bc tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:46:17.503130 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-5cc6b9b6-06a3-4cc0-ad5d-d29be5fbd1bc tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:46:17.509817 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5cc6b9b6-06a3-4cc0-ad5d-d29be5fbd1bc tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:46:17.510269 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5cc6b9b6-06a3-4cc0-ad5d-d29be5fbd1bc tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:46:17.511078 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5cc6b9b6-06a3-4cc0-ad5d-d29be5fbd1bc tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:46:17.511517 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-5cc6b9b6-06a3-4cc0-ad5d-d29be5fbd1bc tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:46:17.538842 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-5cc6b9b6-06a3-4cc0-ad5d-d29be5fbd1bc tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Going to try to terminate instance {{(pid=124200) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 12:46:17.628243 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-5cc6b9b6-06a3-4cc0-ad5d-d29be5fbd1bc tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21" status: 204 len: 0 microversion: 2.1 time: 0.129147 May 23 12:46:17.629078 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 534/1057] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 12:46:17 2022] DELETE /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 12:46:17.638293 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-784021f3-93b9-4389-b157-39276b14528c tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:46:17.638901 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-784021f3-93b9-4389-b157-39276b14528c tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:46:17.645399 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-784021f3-93b9-4389-b157-39276b14528c tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:46:17.645840 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-784021f3-93b9-4389-b157-39276b14528c tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:46:17.646596 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-784021f3-93b9-4389-b157-39276b14528c tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:46:17.647025 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-784021f3-93b9-4389-b157-39276b14528c tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:46:17.790608 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-784021f3-93b9-4389-b157-39276b14528c tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9f4184defc406e8fd753eac219341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51a0c52de248fdb85a7cee23739b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:46:17.799111 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-784021f3-93b9-4389-b157-39276b14528c tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21" status: 200 len: 1554 microversion: 2.1 time: 0.164819 May 23 12:46:17.799703 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 524/1058] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:46:17 2022] GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21 => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:46:18.817259 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-b95443b5-f409-4826-bb3a-56c2e2deb914 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:46:18.817965 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-b95443b5-f409-4826-bb3a-56c2e2deb914 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:46:18.825294 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b95443b5-f409-4826-bb3a-56c2e2deb914 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:46:18.825754 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b95443b5-f409-4826-bb3a-56c2e2deb914 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:46:18.826535 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b95443b5-f409-4826-bb3a-56c2e2deb914 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:46:18.826978 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-b95443b5-f409-4826-bb3a-56c2e2deb914 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:46:18.961266 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-b95443b5-f409-4826-bb3a-56c2e2deb914 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9f4184defc406e8fd753eac219341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51a0c52de248fdb85a7cee23739b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:46:18.969354 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-b95443b5-f409-4826-bb3a-56c2e2deb914 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21" status: 200 len: 1554 microversion: 2.1 time: 0.156324 May 23 12:46:18.969882 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 535/1059] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:46:18 2022] GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:46:19.977302 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-4657c7d4-6ed8-4d16-ac93-6c1162b452eb req-e2b3a9dd-ffc8-406b-b464-67ef172dbf81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f66733e1-e43c-4011-b271-ef705a2a9b21", "name": "network-vif-deleted", "tag": "45b3dda8-fb5f-4e14-8992-d8f97790fbdc"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:46:19.986336 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-4657c7d4-6ed8-4d16-ac93-6c1162b452eb req-e2b3a9dd-ffc8-406b-b464-67ef172dbf81 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:46:19.986777 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-4657c7d4-6ed8-4d16-ac93-6c1162b452eb req-e2b3a9dd-ffc8-406b-b464-67ef172dbf81 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:46:19.987849 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-d1263b60-ce2b-4e8d-85ae-37da895b8b70 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:46:19.988552 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-d1263b60-ce2b-4e8d-85ae-37da895b8b70 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:46:19.995924 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d1263b60-ce2b-4e8d-85ae-37da895b8b70 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:46:19.996827 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d1263b60-ce2b-4e8d-85ae-37da895b8b70 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:46:19.998022 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d1263b60-ce2b-4e8d-85ae-37da895b8b70 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:46:19.998667 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-d1263b60-ce2b-4e8d-85ae-37da895b8b70 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:46:19.999068 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-4657c7d4-6ed8-4d16-ac93-6c1162b452eb req-e2b3a9dd-ffc8-406b-b464-67ef172dbf81 service nova] Creating event network-vif-deleted:45b3dda8-fb5f-4e14-8992-d8f97790fbdc for instance f66733e1-e43c-4011-b271-ef705a2a9b21 on hv-cinder-83699 May 23 12:46:20.004522 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-4657c7d4-6ed8-4d16-ac93-6c1162b452eb req-e2b3a9dd-ffc8-406b-b464-67ef172dbf81 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030779 May 23 12:46:20.007801 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 525/1060] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:46:20.065303 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-d1263b60-ce2b-4e8d-85ae-37da895b8b70 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9f4184defc406e8fd753eac219341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51a0c52de248fdb85a7cee23739b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:46:20.073059 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-d1263b60-ce2b-4e8d-85ae-37da895b8b70 tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21" status: 200 len: 1344 microversion: 2.1 time: 0.089418 May 23 12:46:20.073634 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 536/1061] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:46:19 2022] GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21 => generated 1344 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:46:21.092969 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-ce77123d-012a-48e6-b49c-b7f4388e0f4e tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:46:21.093661 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-ce77123d-012a-48e6-b49c-b7f4388e0f4e tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] [instance: f66733e1-e43c-4011-b271-ef705a2a9b21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:46:21.100053 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ce77123d-012a-48e6-b49c-b7f4388e0f4e tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:46:21.100538 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ce77123d-012a-48e6-b49c-b7f4388e0f4e tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:46:21.101321 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ce77123d-012a-48e6-b49c-b7f4388e0f4e tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:46:21.101762 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ce77123d-012a-48e6-b49c-b7f4388e0f4e tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:46:21.116220 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.wsgi [None req-ce77123d-012a-48e6-b49c-b7f4388e0f4e tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] HTTP exception thrown: Instance f66733e1-e43c-4011-b271-ef705a2a9b21 could not be found. May 23 12:46:21.117900 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-ce77123d-012a-48e6-b49c-b7f4388e0f4e tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Request method failure captured: May 23 12:46:21.117900 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: request: GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21 HTTP/1.1 May 23 12:46:21.117900 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept: application/json May 23 12:46:21.117900 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept-Encoding: identity May 23 12:46:21.117900 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Connection: close May 23 12:46:21.117900 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Length: 0 May 23 12:46:21.117900 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Type: application/json May 23 12:46:21.117900 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Host: 10.222.0.16 May 23 12:46:21.117900 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Openstack-System-Scope: None May 23 12:46:21.117900 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: User-Agent: python-urllib3/1.26.9 May 23 12:46:21.117900 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Auth-Token: gAAAAABii4GcbiTja8RmfDDyUNd-vfa-GTSnOOzIq1EOhaTbRsHS_UrVd5XHYxTWidbHwofBW3fU70wZUQZrn_sjrm-EX2pxrQgVTXio8C3ZOjORArFVTLS7NRUQX32yNeTJfJBKN_KamWVnNH-xBKPVdKzjUDdELlVoeJFge9lITLc-D90S8ac May 23 12:46:21.117900 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Id: None May 23 12:46:21.117900 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Name: None May 23 12:46:21.117900 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Identity-Status: Confirmed May 23 12:46:21.117900 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Is-Admin-Project: True May 23 12:46:21.117900 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Id: default May 23 12:46:21.117900 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Name: Default May 23 12:46:21.117900 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Id: cf51a0c52de248fdb85a7cee23739b4e May 23 12:46:21.117900 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Name: tempest-TestMinimumBasicScenario-1519055551 May 23 12:46:21.117900 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Role: member,reader May 23 12:46:21.117900 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Roles: member,reader May 23 12:46:21.119348 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf51a0c52de248fdb85a7cee23739b4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf51a0c52de248fdb85a7cee23739b4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cf51a0c52de248fdb85a7cee23739b4e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cf51a0c52de248fdb85a7cee23739b4e"}]}] May 23 12:46:21.119348 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant: tempest-TestMinimumBasicScenario-1519055551 May 23 12:46:21.119348 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Id: cf51a0c52de248fdb85a7cee23739b4e May 23 12:46:21.119348 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1519055551 May 23 12:46:21.119348 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User: tempest-TestMinimumBasicScenario-1519055551-project May 23 12:46:21.119348 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Id: default May 23 12:46:21.119348 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Name: Default May 23 12:46:21.119348 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Id: fd9f4184defc406e8fd753eac219341a May 23 12:46:21.119348 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Name: tempest-TestMinimumBasicScenario-1519055551-project May 23 12:46:21.119348 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: method: > May 23 12:46:21.119348 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: exception: Instance f66733e1-e43c-4011-b271-ef705a2a9b21 could not be found. May 23 12:46:21.119348 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: action_args: {'id': 'f66733e1-e43c-4011-b271-ef705a2a9b21'} May 23 12:46:21.120163 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:46:21.120163 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:46:21.120163 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:46:21.120163 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:46:21.120163 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:46:21.120163 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:46:21.120163 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:46:21.120163 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:46:21.120163 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:46:21.120163 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:46:21.120163 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f66733e1-e43c-4011-b271-ef705a2a9b21 could not be found. May 23 12:46:21.120163 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:46:21.120163 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:46:21.120163 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:46:21.120163 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:46:21.120163 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:46:21.120163 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:46:21.120163 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:46:21.120163 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:46:21.120163 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:46:21.122093 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:46:21.122093 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:46:21.122093 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:46:21.122093 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:46:21.122093 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:46:21.122093 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:46:21.122093 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:46:21.122093 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f66733e1-e43c-4011-b271-ef705a2a9b21 could not be found. May 23 12:46:21.122093 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:46:21.122093 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:46:21.122093 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:46:21.122093 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:46:21.122093 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:46:21.122093 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:46:21.122093 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:46:21.122093 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:46:21.122093 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f66733e1-e43c-4011-b271-ef705a2a9b21 could not be found. May 23 12:46:21.122093 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:46:21.123654 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-ce77123d-012a-48e6-b49c-b7f4388e0f4e tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Returning 404 to user: Instance f66733e1-e43c-4011-b271-ef705a2a9b21 could not be found. {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:46:21.123654 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-ce77123d-012a-48e6-b49c-b7f4388e0f4e tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21" status: 404 len: 111 microversion: 2.1 time: 0.031518 May 23 12:46:21.123654 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 526/1062] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:46:21 2022] GET /compute/v2.1/servers/f66733e1-e43c-4011-b271-ef705a2a9b21 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:46:21.128155 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-25411849-d5fa-40f8-883d-35947bdaa9eb tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] Calling method '.version_select at 0x7f095cce6f70>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:46:21.149481 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-25411849-d5fa-40f8-883d-35947bdaa9eb tempest-TestMinimumBasicScenario-1519055551 tempest-TestMinimumBasicScenario-1519055551-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1461676773" status: 202 len: 0 microversion: 2.1 time: 0.025035 May 23 12:46:21.150059 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 537/1063] 10.222.0.16 () {58 vars in 1271 bytes} [Mon May 23 12:46:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1461676773 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 12:46:45.555056 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 12:46:45.555672 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Mon May 23 12:46:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 12:47:05.020518 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-cf41ae6d-847e-4c33-ac10-947fbb98f404 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-12971945", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-975896852", "security_groups": [{"name": "tempest-secgroup-smoke-1035934523"}], "block_device_mapping_v2": [{"uuid": "6a7e1e13-639a-4774-82cc-662413fd63a9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "12b22b49-c25e-4ae4-ac66-3d3f23b3684e"}]}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:47:05.029688 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_api:SELECT=14 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:05.030560 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell1:SELECT=26 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:05.139070 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.network.neutron [None req-cf41ae6d-847e-4c33-ac10-947fbb98f404 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] validate_networks() for [('12b22b49-c25e-4ae4-ac66-3d3f23b3684e', None, None, None, None, None)] {{(pid=124199) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 12:47:05.632570 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-cf41ae6d-847e-4c33-ac10-947fbb98f404 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Flavor limits 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 12:47:05.632998 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-cf41ae6d-847e-4c33-ac10-947fbb98f404 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Image limits 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 12:47:05.633473 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-cf41ae6d-847e-4c33-ac10-947fbb98f404 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Flavor pref 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 12:47:05.633915 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-cf41ae6d-847e-4c33-ac10-947fbb98f404 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Image pref 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 12:47:05.634327 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-cf41ae6d-847e-4c33-ac10-947fbb98f404 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 12:47:05.644372 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cf41ae6d-847e-4c33-ac10-947fbb98f404 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:05.644846 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cf41ae6d-847e-4c33-ac10-947fbb98f404 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:05.645656 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cf41ae6d-847e-4c33-ac10-947fbb98f404 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:05.646095 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cf41ae6d-847e-4c33-ac10-947fbb98f404 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:05.664285 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-cf41ae6d-847e-4c33-ac10-947fbb98f404 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Getting quotas for project ac5975413f5548c3881ec3c868295836. Resources: {'instances', 'cores', 'ram'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:47:05.668677 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-cf41ae6d-847e-4c33-ac10-947fbb98f404 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Getting quotas for user 024cf85a89d445ff854fede06d0f9244 and project ac5975413f5548c3881ec3c868295836. Resources: {'instances', 'cores', 'ram'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:47:05.728506 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-cf41ae6d-847e-4c33-ac10-947fbb98f404 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Going to run 1 instances... {{(pid=124199) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 12:47:05.730664 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-cf41ae6d-847e-4c33-ac10-947fbb98f404 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6a7e1e13-639a-4774-82cc-662413fd63a9',volume_size=None,volume_type=None)] {{(pid=124199) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 12:47:05.860890 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-cf41ae6d-847e-4c33-ac10-947fbb98f404 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.844287 May 23 12:47:05.861518 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 527/1064] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 23 12:47:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 12:47:05.871544 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-00c5ebab-aa07-4e03-b99d-71690f7dad93 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:47:05.872146 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-00c5ebab-aa07-4e03-b99d-71690f7dad93 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:47:05.876463 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:05.877119 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:05.938160 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-00c5ebab-aa07-4e03-b99d-71690f7dad93 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:47:05.945178 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-00c5ebab-aa07-4e03-b99d-71690f7dad93 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b" status: 200 len: 1092 microversion: 2.1 time: 0.077533 May 23 12:47:05.946047 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 538/1065] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:47:05 2022] GET /compute/v2.1/servers/7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b => generated 1092 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:47:06.963480 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-8e9da2f6-0af3-4b07-a7bf-4c948b2bfeb7 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:47:06.964218 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-8e9da2f6-0af3-4b07-a7bf-4c948b2bfeb7 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:47:06.971461 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8e9da2f6-0af3-4b07-a7bf-4c948b2bfeb7 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:06.972000 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8e9da2f6-0af3-4b07-a7bf-4c948b2bfeb7 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:06.972881 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8e9da2f6-0af3-4b07-a7bf-4c948b2bfeb7 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:06.973394 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8e9da2f6-0af3-4b07-a7bf-4c948b2bfeb7 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:07.047745 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-8e9da2f6-0af3-4b07-a7bf-4c948b2bfeb7 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:47:07.055402 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-8e9da2f6-0af3-4b07-a7bf-4c948b2bfeb7 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b" status: 200 len: 1208 microversion: 2.1 time: 0.096271 May 23 12:47:07.056061 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 528/1066] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:47:06 2022] GET /compute/v2.1/servers/7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b => generated 1208 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:47:08.074353 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-da4513a1-76b2-45aa-b474-2e1f174018f8 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:47:08.076045 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-da4513a1-76b2-45aa-b474-2e1f174018f8 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:47:08.084574 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-da4513a1-76b2-45aa-b474-2e1f174018f8 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:08.085367 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-da4513a1-76b2-45aa-b474-2e1f174018f8 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:08.086386 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-da4513a1-76b2-45aa-b474-2e1f174018f8 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:08.086993 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-da4513a1-76b2-45aa-b474-2e1f174018f8 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:08.281792 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-8b5bae85-4841-48f9-a18a-c25f583a3ad9 req-b21479b2-f5e4-49ce-82a7-2c913e157520 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b", "tag": "43b8ca9b-fcfc-40ab-a568-72942f20ba61"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:47:08.292753 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-8b5bae85-4841-48f9-a18a-c25f583a3ad9 req-b21479b2-f5e4-49ce-82a7-2c913e157520 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:08.293383 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-8b5bae85-4841-48f9-a18a-c25f583a3ad9 req-b21479b2-f5e4-49ce-82a7-2c913e157520 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:08.307965 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-8b5bae85-4841-48f9-a18a-c25f583a3ad9 req-b21479b2-f5e4-49ce-82a7-2c913e157520 service nova] Creating event network-changed:43b8ca9b-fcfc-40ab-a568-72942f20ba61 for instance 7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b on hv-cinder-83699 May 23 12:47:08.314377 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-8b5bae85-4841-48f9-a18a-c25f583a3ad9 req-b21479b2-f5e4-49ce-82a7-2c913e157520 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041516 May 23 12:47:08.315267 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 529/1067] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:47:08.398433 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-da4513a1-76b2-45aa-b474-2e1f174018f8 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:47:08.407079 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-da4513a1-76b2-45aa-b474-2e1f174018f8 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b" status: 200 len: 1264 microversion: 2.1 time: 0.338156 May 23 12:47:08.407659 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 539/1068] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:47:08 2022] GET /compute/v2.1/servers/7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b => generated 1264 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:47:09.424866 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-84901748-0b83-4622-b7dd-c88038ecdce8 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:47:09.425568 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-84901748-0b83-4622-b7dd-c88038ecdce8 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:47:09.432373 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-84901748-0b83-4622-b7dd-c88038ecdce8 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:09.432832 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-84901748-0b83-4622-b7dd-c88038ecdce8 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:09.433630 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-84901748-0b83-4622-b7dd-c88038ecdce8 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:09.434053 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-84901748-0b83-4622-b7dd-c88038ecdce8 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:09.572464 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-84901748-0b83-4622-b7dd-c88038ecdce8 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:47:09.580647 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-84901748-0b83-4622-b7dd-c88038ecdce8 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b" status: 200 len: 1264 microversion: 2.1 time: 0.159865 May 23 12:47:09.581243 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 530/1069] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:47:09 2022] GET /compute/v2.1/servers/7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:47:10.597455 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-85420156-fdce-49fd-a81f-97a7be3c1391 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:47:10.598084 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-85420156-fdce-49fd-a81f-97a7be3c1391 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:47:10.604574 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-85420156-fdce-49fd-a81f-97a7be3c1391 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:10.605021 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-85420156-fdce-49fd-a81f-97a7be3c1391 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:10.605789 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-85420156-fdce-49fd-a81f-97a7be3c1391 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:10.606224 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-85420156-fdce-49fd-a81f-97a7be3c1391 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:10.736140 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-85420156-fdce-49fd-a81f-97a7be3c1391 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:47:10.744687 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-85420156-fdce-49fd-a81f-97a7be3c1391 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b" status: 200 len: 1264 microversion: 2.1 time: 0.151061 May 23 12:47:10.745265 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 540/1070] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:47:10 2022] GET /compute/v2.1/servers/7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:47:11.761396 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-6aafb798-37a8-4d2a-837c-ab9aabf8b256 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:47:11.761991 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-6aafb798-37a8-4d2a-837c-ab9aabf8b256 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:47:11.769258 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6aafb798-37a8-4d2a-837c-ab9aabf8b256 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:11.769707 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6aafb798-37a8-4d2a-837c-ab9aabf8b256 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:11.770477 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6aafb798-37a8-4d2a-837c-ab9aabf8b256 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:11.770915 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6aafb798-37a8-4d2a-837c-ab9aabf8b256 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:11.919121 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-6aafb798-37a8-4d2a-837c-ab9aabf8b256 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:47:11.926740 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-6aafb798-37a8-4d2a-837c-ab9aabf8b256 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b" status: 200 len: 1264 microversion: 2.1 time: 0.169292 May 23 12:47:11.927309 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 531/1071] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:47:11 2022] GET /compute/v2.1/servers/7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:47:12.944207 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-1c292a70-233a-4b3a-8f31-66b28d63221e tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:47:12.944830 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-1c292a70-233a-4b3a-8f31-66b28d63221e tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:47:12.951532 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1c292a70-233a-4b3a-8f31-66b28d63221e tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:12.951991 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1c292a70-233a-4b3a-8f31-66b28d63221e tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:12.952803 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1c292a70-233a-4b3a-8f31-66b28d63221e tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:12.953250 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-1c292a70-233a-4b3a-8f31-66b28d63221e tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:13.087942 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-1c292a70-233a-4b3a-8f31-66b28d63221e tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:47:13.096250 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-1c292a70-233a-4b3a-8f31-66b28d63221e tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b" status: 200 len: 1264 microversion: 2.1 time: 0.156285 May 23 12:47:13.096826 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 541/1072] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:47:12 2022] GET /compute/v2.1/servers/7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:47:14.112959 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-edfa86d8-4f79-48d7-aaf9-c131dea869dd tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:47:14.113552 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-edfa86d8-4f79-48d7-aaf9-c131dea869dd tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:47:14.120333 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-edfa86d8-4f79-48d7-aaf9-c131dea869dd tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:14.120788 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-edfa86d8-4f79-48d7-aaf9-c131dea869dd tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:14.121566 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-edfa86d8-4f79-48d7-aaf9-c131dea869dd tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:14.122509 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-edfa86d8-4f79-48d7-aaf9-c131dea869dd tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:14.268806 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-edfa86d8-4f79-48d7-aaf9-c131dea869dd tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:47:14.276153 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-edfa86d8-4f79-48d7-aaf9-c131dea869dd tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b" status: 200 len: 1264 microversion: 2.1 time: 0.167126 May 23 12:47:14.276732 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 532/1073] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:47:14 2022] GET /compute/v2.1/servers/7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:47:15.293210 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-8e2f6586-f9fc-498c-bea5-86ebdf2c0304 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:47:15.294359 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-8e2f6586-f9fc-498c-bea5-86ebdf2c0304 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:47:15.301206 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8e2f6586-f9fc-498c-bea5-86ebdf2c0304 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:15.301661 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8e2f6586-f9fc-498c-bea5-86ebdf2c0304 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:15.302434 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8e2f6586-f9fc-498c-bea5-86ebdf2c0304 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:15.302872 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-8e2f6586-f9fc-498c-bea5-86ebdf2c0304 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:15.440685 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-8e2f6586-f9fc-498c-bea5-86ebdf2c0304 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:47:15.452051 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-8e2f6586-f9fc-498c-bea5-86ebdf2c0304 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b" status: 200 len: 1264 microversion: 2.1 time: 0.159031 May 23 12:47:15.452689 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 542/1074] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:47:15 2022] GET /compute/v2.1/servers/7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:47:16.468956 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0be82d4d-f289-4ea3-9537-ff1d8f92c1b8 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:47:16.469564 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-0be82d4d-f289-4ea3-9537-ff1d8f92c1b8 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:47:16.472104 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell0:SELECT=2 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:16.472935 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell0:SELECT=6 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:16.478354 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0be82d4d-f289-4ea3-9537-ff1d8f92c1b8 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:16.478787 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0be82d4d-f289-4ea3-9537-ff1d8f92c1b8 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:16.479549 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0be82d4d-f289-4ea3-9537-ff1d8f92c1b8 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:16.479981 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0be82d4d-f289-4ea3-9537-ff1d8f92c1b8 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:16.613634 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0be82d4d-f289-4ea3-9537-ff1d8f92c1b8 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:47:16.621063 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-0be82d4d-f289-4ea3-9537-ff1d8f92c1b8 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b" status: 200 len: 1264 microversion: 2.1 time: 0.156645 May 23 12:47:16.621622 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 533/1075] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:47:16 2022] GET /compute/v2.1/servers/7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:47:17.638249 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell0:SELECT=2 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:17.777178 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-69c52c83-1104-4e0e-a6d2-42d31e40b888 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:47:17.777797 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-69c52c83-1104-4e0e-a6d2-42d31e40b888 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:47:17.783872 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-69c52c83-1104-4e0e-a6d2-42d31e40b888 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:17.784375 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-69c52c83-1104-4e0e-a6d2-42d31e40b888 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:17.785153 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-69c52c83-1104-4e0e-a6d2-42d31e40b888 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:17.785595 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-69c52c83-1104-4e0e-a6d2-42d31e40b888 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:17.926030 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-69c52c83-1104-4e0e-a6d2-42d31e40b888 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:47:17.933703 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-69c52c83-1104-4e0e-a6d2-42d31e40b888 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b" status: 200 len: 1264 microversion: 2.1 time: 0.300119 May 23 12:47:17.934280 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 543/1076] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:47:17 2022] GET /compute/v2.1/servers/7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b => generated 1264 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:47:18.951496 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-91db8d47-e84a-49af-805a-aef8e17c38d8 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:47:18.952155 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-91db8d47-e84a-49af-805a-aef8e17c38d8 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:47:18.959237 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-91db8d47-e84a-49af-805a-aef8e17c38d8 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:18.959690 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-91db8d47-e84a-49af-805a-aef8e17c38d8 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:18.960524 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-91db8d47-e84a-49af-805a-aef8e17c38d8 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:18.960971 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-91db8d47-e84a-49af-805a-aef8e17c38d8 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:19.095258 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-91db8d47-e84a-49af-805a-aef8e17c38d8 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:47:19.103520 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-91db8d47-e84a-49af-805a-aef8e17c38d8 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b" status: 200 len: 1264 microversion: 2.1 time: 0.156513 May 23 12:47:19.104095 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 534/1077] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:47:18 2022] GET /compute/v2.1/servers/7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:47:19.268291 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-e27e2aa6-58a4-4084-987f-90b773261f15 req-e3b3e172-d191-42ab-869f-da5fd563ec15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b", "name": "network-vif-plugged", "status": "completed", "tag": "43b8ca9b-fcfc-40ab-a568-72942f20ba61"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:47:19.277522 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-e27e2aa6-58a4-4084-987f-90b773261f15 req-e3b3e172-d191-42ab-869f-da5fd563ec15 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:19.278064 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-e27e2aa6-58a4-4084-987f-90b773261f15 req-e3b3e172-d191-42ab-869f-da5fd563ec15 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:19.291864 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-e27e2aa6-58a4-4084-987f-90b773261f15 req-e3b3e172-d191-42ab-869f-da5fd563ec15 service nova] Creating event network-vif-plugged:43b8ca9b-fcfc-40ab-a568-72942f20ba61 for instance 7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b on hv-cinder-83699 May 23 12:47:19.297852 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-e27e2aa6-58a4-4084-987f-90b773261f15 req-e3b3e172-d191-42ab-869f-da5fd563ec15 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033272 May 23 12:47:19.298457 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 544/1078] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:47:20.120541 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-2d752089-0354-4b63-ab3f-7d0df27086aa tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:47:20.121142 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-2d752089-0354-4b63-ab3f-7d0df27086aa tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:47:20.127857 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2d752089-0354-4b63-ab3f-7d0df27086aa tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:20.128354 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2d752089-0354-4b63-ab3f-7d0df27086aa tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:20.129136 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2d752089-0354-4b63-ab3f-7d0df27086aa tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:20.129569 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2d752089-0354-4b63-ab3f-7d0df27086aa tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:20.271768 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-2d752089-0354-4b63-ab3f-7d0df27086aa tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:47:20.280405 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-2d752089-0354-4b63-ab3f-7d0df27086aa tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b" status: 200 len: 1264 microversion: 2.1 time: 0.163640 May 23 12:47:20.280900 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 535/1079] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:47:20 2022] GET /compute/v2.1/servers/7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:47:21.298254 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-f6f10c83-fb7a-4532-9f96-038fffb37053 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:47:21.298883 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-f6f10c83-fb7a-4532-9f96-038fffb37053 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:47:21.305560 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f6f10c83-fb7a-4532-9f96-038fffb37053 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:21.306004 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f6f10c83-fb7a-4532-9f96-038fffb37053 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:21.306769 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f6f10c83-fb7a-4532-9f96-038fffb37053 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:21.307200 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-f6f10c83-fb7a-4532-9f96-038fffb37053 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:21.446651 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-f6f10c83-fb7a-4532-9f96-038fffb37053 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:47:21.457265 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-f6f10c83-fb7a-4532-9f96-038fffb37053 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b" status: 200 len: 1452 microversion: 2.1 time: 0.163353 May 23 12:47:21.457842 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 545/1080] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:47:21 2022] GET /compute/v2.1/servers/7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:47:21.474378 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-50fe8fbd-8185-4057-934b-39673cdbad7a tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:47:21.474994 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-50fe8fbd-8185-4057-934b-39673cdbad7a tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:47:21.481817 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-50fe8fbd-8185-4057-934b-39673cdbad7a tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:21.482273 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-50fe8fbd-8185-4057-934b-39673cdbad7a tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:21.483059 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-50fe8fbd-8185-4057-934b-39673cdbad7a tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:21.483507 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-50fe8fbd-8185-4057-934b-39673cdbad7a tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:21.628053 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-50fe8fbd-8185-4057-934b-39673cdbad7a tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:47:21.635577 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-50fe8fbd-8185-4057-934b-39673cdbad7a tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b" status: 200 len: 1452 microversion: 2.1 time: 0.165076 May 23 12:47:21.636139 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 536/1081] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:47:21 2022] GET /compute/v2.1/servers/7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:47:23.600202 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-d37ab986-b774-4280-b14c-67caaaa8fc1b req-09a9b7c3-8b84-4b46-9295-7cfd2220ff2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b", "tag": "43b8ca9b-fcfc-40ab-a568-72942f20ba61"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:47:23.609081 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-d37ab986-b774-4280-b14c-67caaaa8fc1b req-09a9b7c3-8b84-4b46-9295-7cfd2220ff2c service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:23.609525 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-d37ab986-b774-4280-b14c-67caaaa8fc1b req-09a9b7c3-8b84-4b46-9295-7cfd2220ff2c service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:23.621092 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-d37ab986-b774-4280-b14c-67caaaa8fc1b req-09a9b7c3-8b84-4b46-9295-7cfd2220ff2c service nova] Creating event network-changed:43b8ca9b-fcfc-40ab-a568-72942f20ba61 for instance 7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b on hv-cinder-83699 May 23 12:47:23.626313 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-d37ab986-b774-4280-b14c-67caaaa8fc1b req-09a9b7c3-8b84-4b46-9295-7cfd2220ff2c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029780 May 23 12:47:23.626922 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 546/1082] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:48:51.692573 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:51.693747 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG dbcounter [-] [124199] Writing DB stats nova_cell1:SELECT=52 {{(pid=124199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:51.697747 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_api:SELECT=20 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:51.698826 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG dbcounter [-] [124200] Writing DB stats nova_cell1:SELECT=40 {{(pid=124200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:51.699975 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-aab64e1e-2bfa-4c5f-b4dd-cda517e252ee tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:51.700715 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-aab64e1e-2bfa-4c5f-b4dd-cda517e252ee tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:51.704433 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-4a071324-1401-416e-8717-abc3cbef571a req-cd57b71c-147d-4dc2-9b57-a544eb56583a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b", "tag": "43b8ca9b-fcfc-40ab-a568-72942f20ba61"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:48:51.708611 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-aab64e1e-2bfa-4c5f-b4dd-cda517e252ee tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:51.709068 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-aab64e1e-2bfa-4c5f-b4dd-cda517e252ee tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:51.709909 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-aab64e1e-2bfa-4c5f-b4dd-cda517e252ee tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:51.710347 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-aab64e1e-2bfa-4c5f-b4dd-cda517e252ee tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:51.715352 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-4a071324-1401-416e-8717-abc3cbef571a req-cd57b71c-147d-4dc2-9b57-a544eb56583a service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:51.715799 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-4a071324-1401-416e-8717-abc3cbef571a req-cd57b71c-147d-4dc2-9b57-a544eb56583a service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:51.734716 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-4a071324-1401-416e-8717-abc3cbef571a req-cd57b71c-147d-4dc2-9b57-a544eb56583a service nova] Creating event network-changed:43b8ca9b-fcfc-40ab-a568-72942f20ba61 for instance 7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b on hv-cinder-83699 May 23 12:48:51.741048 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-4a071324-1401-416e-8717-abc3cbef571a req-cd57b71c-147d-4dc2-9b57-a544eb56583a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047185 May 23 12:48:51.741306 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-aab64e1e-2bfa-4c5f-b4dd-cda517e252ee tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b] Going to try to terminate instance {{(pid=124199) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 12:48:51.742007 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 547/1083] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:48:51.843500 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-aab64e1e-2bfa-4c5f-b4dd-cda517e252ee tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b" status: 204 len: 0 microversion: 2.1 time: 0.150207 May 23 12:48:51.846538 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 537/1084] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 12:48:51 2022] DELETE /compute/v2.1/servers/7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 12:48:51.856094 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-ec6966eb-b8db-4e58-834c-d744ece98a3c tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:51.856947 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-ec6966eb-b8db-4e58-834c-d744ece98a3c tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:51.863886 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ec6966eb-b8db-4e58-834c-d744ece98a3c tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:51.864468 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ec6966eb-b8db-4e58-834c-d744ece98a3c tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:51.865421 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ec6966eb-b8db-4e58-834c-d744ece98a3c tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:51.865933 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ec6966eb-b8db-4e58-834c-d744ece98a3c tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:52.079377 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-ec6966eb-b8db-4e58-834c-d744ece98a3c tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:52.087606 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-ec6966eb-b8db-4e58-834c-d744ece98a3c tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b" status: 200 len: 1576 microversion: 2.1 time: 0.238754 May 23 12:48:52.089205 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 548/1085] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:48:51 2022] GET /compute/v2.1/servers/7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b => generated 1576 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:48:53.107137 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-5b3e4aea-4d0f-4c98-8f3c-e99f9e62c9c1 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:53.107844 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-5b3e4aea-4d0f-4c98-8f3c-e99f9e62c9c1 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:53.114579 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5b3e4aea-4d0f-4c98-8f3c-e99f9e62c9c1 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:53.115029 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5b3e4aea-4d0f-4c98-8f3c-e99f9e62c9c1 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:53.115813 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5b3e4aea-4d0f-4c98-8f3c-e99f9e62c9c1 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:53.116274 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5b3e4aea-4d0f-4c98-8f3c-e99f9e62c9c1 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:53.366197 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-5b3e4aea-4d0f-4c98-8f3c-e99f9e62c9c1 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:53.375309 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-5b3e4aea-4d0f-4c98-8f3c-e99f9e62c9c1 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b" status: 200 len: 1576 microversion: 2.1 time: 0.273027 May 23 12:48:53.385255 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 538/1086] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:48:53 2022] GET /compute/v2.1/servers/7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b => generated 1576 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:48:53.842448 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-2212cfa2-b13b-4ad0-8b33-6244b0a422ec req-b880cf4f-ce9b-4596-9d22-ec340489fa18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b", "name": "network-vif-deleted", "tag": "43b8ca9b-fcfc-40ab-a568-72942f20ba61"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:48:53.850911 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-2212cfa2-b13b-4ad0-8b33-6244b0a422ec req-b880cf4f-ce9b-4596-9d22-ec340489fa18 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:53.851431 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-2212cfa2-b13b-4ad0-8b33-6244b0a422ec req-b880cf4f-ce9b-4596-9d22-ec340489fa18 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:53.864341 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-2212cfa2-b13b-4ad0-8b33-6244b0a422ec req-b880cf4f-ce9b-4596-9d22-ec340489fa18 service nova] Creating event network-vif-deleted:43b8ca9b-fcfc-40ab-a568-72942f20ba61 for instance 7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b on hv-cinder-83699 May 23 12:48:53.868659 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-2212cfa2-b13b-4ad0-8b33-6244b0a422ec req-b880cf4f-ce9b-4596-9d22-ec340489fa18 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030550 May 23 12:48:53.869805 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 549/1087] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:48:54.393062 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-ee86f31c-4bd5-4243-adc3-f691813283c1 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:54.393618 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-ee86f31c-4bd5-4243-adc3-f691813283c1 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:54.401030 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ee86f31c-4bd5-4243-adc3-f691813283c1 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:54.401605 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ee86f31c-4bd5-4243-adc3-f691813283c1 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:54.402574 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ee86f31c-4bd5-4243-adc3-f691813283c1 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:54.403019 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ee86f31c-4bd5-4243-adc3-f691813283c1 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:54.436859 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ee86f31c-4bd5-4243-adc3-f691813283c1 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:54.437331 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ee86f31c-4bd5-4243-adc3-f691813283c1 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:54.437780 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.objects.instance [None req-ee86f31c-4bd5-4243-adc3-f691813283c1 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lazy-loading 'fault' on Instance uuid 7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b {{(pid=124199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:48:54.482512 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-ee86f31c-4bd5-4243-adc3-f691813283c1 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:54.490225 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-ee86f31c-4bd5-4243-adc3-f691813283c1 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b" status: 200 len: 1228 microversion: 2.1 time: 0.101046 May 23 12:48:54.490806 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 539/1088] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:48:54 2022] GET /compute/v2.1/servers/7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b => generated 1228 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:48:55.510900 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-6dfe6e7b-ea57-496b-b707-cda8850d52f6 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:55.511628 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-6dfe6e7b-ea57-496b-b707-cda8850d52f6 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:55.517924 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6dfe6e7b-ea57-496b-b707-cda8850d52f6 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:55.518368 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6dfe6e7b-ea57-496b-b707-cda8850d52f6 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:55.519137 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6dfe6e7b-ea57-496b-b707-cda8850d52f6 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:55.519568 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-6dfe6e7b-ea57-496b-b707-cda8850d52f6 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:55.534602 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.wsgi [None req-6dfe6e7b-ea57-496b-b707-cda8850d52f6 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] HTTP exception thrown: Instance 7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b could not be found. May 23 12:48:55.536283 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-6dfe6e7b-ea57-496b-b707-cda8850d52f6 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Request method failure captured: May 23 12:48:55.536283 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: request: GET /compute/v2.1/servers/7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b HTTP/1.1 May 23 12:48:55.536283 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept: application/json May 23 12:48:55.536283 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept-Encoding: identity May 23 12:48:55.536283 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Connection: close May 23 12:48:55.536283 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Length: 0 May 23 12:48:55.536283 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Type: application/json May 23 12:48:55.536283 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Host: 10.222.0.16 May 23 12:48:55.536283 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Openstack-System-Scope: None May 23 12:48:55.536283 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: User-Agent: python-urllib3/1.26.9 May 23 12:48:55.536283 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Auth-Token: gAAAAABii4Ekyf6cwYkorK1YLyy_p53XTPvC63_eNQJ2wcC3bEgrf_x8OBT3OlXsSL-P2gxXF6NAtJWekx8C05xv97nimL05Ugq9KXiXcKZIcMDZ9JTXc-NxRHw8U8Eb2OzIvM0_h-powEforGgpbP_cy7B_JnF-mpeYNUVNzfUQOPrHREBZ40s May 23 12:48:55.536283 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Id: None May 23 12:48:55.536283 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Name: None May 23 12:48:55.536283 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Identity-Status: Confirmed May 23 12:48:55.536283 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Is-Admin-Project: True May 23 12:48:55.536283 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Id: default May 23 12:48:55.536283 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Name: Default May 23 12:48:55.536283 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Id: ac5975413f5548c3881ec3c868295836 May 23 12:48:55.536283 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Name: tempest-TestVolumeBootPattern-1357796398 May 23 12:48:55.536283 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Role: member,reader May 23 12:48:55.536283 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Roles: member,reader May 23 12:48:55.538384 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ac5975413f5548c3881ec3c868295836"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ac5975413f5548c3881ec3c868295836"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ac5975413f5548c3881ec3c868295836", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ac5975413f5548c3881ec3c868295836"}]}] May 23 12:48:55.538384 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant: tempest-TestVolumeBootPattern-1357796398 May 23 12:48:55.538384 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Id: ac5975413f5548c3881ec3c868295836 May 23 12:48:55.538384 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Name: tempest-TestVolumeBootPattern-1357796398 May 23 12:48:55.538384 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User: tempest-TestVolumeBootPattern-1357796398-project May 23 12:48:55.538384 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Id: default May 23 12:48:55.538384 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Name: Default May 23 12:48:55.538384 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Id: 024cf85a89d445ff854fede06d0f9244 May 23 12:48:55.538384 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Name: tempest-TestVolumeBootPattern-1357796398-project May 23 12:48:55.538384 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: method: > May 23 12:48:55.538384 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: exception: Instance 7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b could not be found. May 23 12:48:55.538384 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: action_args: {'id': '7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b'} May 23 12:48:55.539379 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:48:55.539379 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:48:55.539379 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:48:55.539379 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:48:55.539379 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:48:55.539379 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:48:55.539379 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:48:55.539379 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:48:55.539379 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:48:55.539379 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:48:55.539379 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b could not be found. May 23 12:48:55.539379 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:48:55.539379 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:48:55.539379 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:48:55.539379 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:48:55.539379 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:48:55.539379 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:48:55.539379 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:48:55.539379 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:48:55.539379 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:48:55.541653 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:48:55.541653 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:48:55.541653 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:48:55.541653 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:48:55.541653 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:48:55.541653 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:48:55.541653 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:48:55.541653 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b could not be found. May 23 12:48:55.541653 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:48:55.541653 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:48:55.541653 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:48:55.541653 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:48:55.541653 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:48:55.541653 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:48:55.541653 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:48:55.541653 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:48:55.541653 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b could not be found. May 23 12:48:55.541653 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:48:55.543205 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-6dfe6e7b-ea57-496b-b707-cda8850d52f6 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Returning 404 to user: Instance 7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b could not be found. {{(pid=124200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:48:55.543205 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-6dfe6e7b-ea57-496b-b707-cda8850d52f6 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b" status: 404 len: 111 microversion: 2.1 time: 0.031901 May 23 12:48:55.543205 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 550/1089] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:48:55 2022] GET /compute/v2.1/servers/7dcb6ac4-f949-4ee2-983c-a7e93f74ce8b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 12:48:58.900929 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-7d27eca8-f54b-4de9-98b9-39a7f9cb75cf tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:58.901603 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-7d27eca8-f54b-4de9-98b9-39a7f9cb75cf tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 78e5c6e8-06cd-469c-98b9-f36b067796f2] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:58.903278 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-45be49d1-13dd-4481-966d-f2063871b30c req-0ffa5260-be3e-4beb-af2b-a3bdb940a673 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78e5c6e8-06cd-469c-98b9-f36b067796f2", "tag": "eb2d3ef6-0647-4cc3-acdf-fa6e85c2b219"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:48:58.909377 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7d27eca8-f54b-4de9-98b9-39a7f9cb75cf tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:58.910157 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7d27eca8-f54b-4de9-98b9-39a7f9cb75cf tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:58.910947 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7d27eca8-f54b-4de9-98b9-39a7f9cb75cf tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:58.911393 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7d27eca8-f54b-4de9-98b9-39a7f9cb75cf tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:58.912648 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-45be49d1-13dd-4481-966d-f2063871b30c req-0ffa5260-be3e-4beb-af2b-a3bdb940a673 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:58.913099 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-45be49d1-13dd-4481-966d-f2063871b30c req-0ffa5260-be3e-4beb-af2b-a3bdb940a673 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:58.926132 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-45be49d1-13dd-4481-966d-f2063871b30c req-0ffa5260-be3e-4beb-af2b-a3bdb940a673 service nova] Creating event network-changed:eb2d3ef6-0647-4cc3-acdf-fa6e85c2b219 for instance 78e5c6e8-06cd-469c-98b9-f36b067796f2 on hv-cinder-83699 May 23 12:48:58.932717 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-45be49d1-13dd-4481-966d-f2063871b30c req-0ffa5260-be3e-4beb-af2b-a3bdb940a673 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033171 May 23 12:48:58.933932 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 551/1090] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:48:58.944726 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-7d27eca8-f54b-4de9-98b9-39a7f9cb75cf tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 78e5c6e8-06cd-469c-98b9-f36b067796f2] Going to try to terminate instance {{(pid=124199) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 12:48:59.035223 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-7d27eca8-f54b-4de9-98b9-39a7f9cb75cf tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "DELETE /compute/v2.1/servers/78e5c6e8-06cd-469c-98b9-f36b067796f2" status: 204 len: 0 microversion: 2.1 time: 0.137764 May 23 12:48:59.036077 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 540/1091] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 12:48:58 2022] DELETE /compute/v2.1/servers/78e5c6e8-06cd-469c-98b9-f36b067796f2 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 12:48:59.049364 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-3914b948-cf67-4228-8e75-1e126e7be51b tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:59.050528 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-3914b948-cf67-4228-8e75-1e126e7be51b tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 78e5c6e8-06cd-469c-98b9-f36b067796f2] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:59.060267 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3914b948-cf67-4228-8e75-1e126e7be51b tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:59.061111 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3914b948-cf67-4228-8e75-1e126e7be51b tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:59.062410 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3914b948-cf67-4228-8e75-1e126e7be51b tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:59.063159 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-3914b948-cf67-4228-8e75-1e126e7be51b tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:59.224233 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.policy [None req-3914b948-cf67-4228-8e75-1e126e7be51b tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124200) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:59.232776 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-3914b948-cf67-4228-8e75-1e126e7be51b tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/78e5c6e8-06cd-469c-98b9-f36b067796f2" status: 200 len: 1577 microversion: 2.1 time: 0.191719 May 23 12:48:59.233534 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 552/1092] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:48:59 2022] GET /compute/v2.1/servers/78e5c6e8-06cd-469c-98b9-f36b067796f2 => generated 1577 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:00.251378 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-11ecd65f-f91a-4d27-989d-f9ecb590f796 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:00.252071 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-11ecd65f-f91a-4d27-989d-f9ecb590f796 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 78e5c6e8-06cd-469c-98b9-f36b067796f2] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:00.258302 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-11ecd65f-f91a-4d27-989d-f9ecb590f796 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:00.258746 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-11ecd65f-f91a-4d27-989d-f9ecb590f796 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:00.259581 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-11ecd65f-f91a-4d27-989d-f9ecb590f796 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:00.260118 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-11ecd65f-f91a-4d27-989d-f9ecb590f796 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:00.395778 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-11ecd65f-f91a-4d27-989d-f9ecb590f796 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:00.403827 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-11ecd65f-f91a-4d27-989d-f9ecb590f796 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/78e5c6e8-06cd-469c-98b9-f36b067796f2" status: 200 len: 1577 microversion: 2.1 time: 0.156630 May 23 12:49:00.404434 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 541/1093] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:49:00 2022] GET /compute/v2.1/servers/78e5c6e8-06cd-469c-98b9-f36b067796f2 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:01.002049 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [req-243cbeda-3d75-4d54-bebb-813a4ff0442a req-faa05d2a-e7ef-45b6-a4f5-2bf1e42ba458 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78e5c6e8-06cd-469c-98b9-f36b067796f2", "name": "network-vif-deleted", "tag": "eb2d3ef6-0647-4cc3-acdf-fa6e85c2b219"}]} {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:49:01.011778 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-243cbeda-3d75-4d54-bebb-813a4ff0442a req-faa05d2a-e7ef-45b6-a4f5-2bf1e42ba458 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:01.012435 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [req-243cbeda-3d75-4d54-bebb-813a4ff0442a req-faa05d2a-e7ef-45b6-a4f5-2bf1e42ba458 service nova] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:01.029333 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.compute.server_external_events [req-243cbeda-3d75-4d54-bebb-813a4ff0442a req-faa05d2a-e7ef-45b6-a4f5-2bf1e42ba458 service nova] Creating event network-vif-deleted:eb2d3ef6-0647-4cc3-acdf-fa6e85c2b219 for instance 78e5c6e8-06cd-469c-98b9-f36b067796f2 on hv-cinder-83699 May 23 12:49:01.034503 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [req-243cbeda-3d75-4d54-bebb-813a4ff0442a req-faa05d2a-e7ef-45b6-a4f5-2bf1e42ba458 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035987 May 23 12:49:01.035249 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 553/1094] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 12:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:49:01.421732 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-9fbe7e05-02b8-42f1-983f-91d71644d69d tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:01.422976 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-9fbe7e05-02b8-42f1-983f-91d71644d69d tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 78e5c6e8-06cd-469c-98b9-f36b067796f2] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:01.429963 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9fbe7e05-02b8-42f1-983f-91d71644d69d tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:01.430692 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9fbe7e05-02b8-42f1-983f-91d71644d69d tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:01.431726 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9fbe7e05-02b8-42f1-983f-91d71644d69d tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:01.432381 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9fbe7e05-02b8-42f1-983f-91d71644d69d tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:01.471335 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9fbe7e05-02b8-42f1-983f-91d71644d69d tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:01.471792 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9fbe7e05-02b8-42f1-983f-91d71644d69d tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:01.472265 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.objects.instance [None req-9fbe7e05-02b8-42f1-983f-91d71644d69d tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lazy-loading 'fault' on Instance uuid 78e5c6e8-06cd-469c-98b9-f36b067796f2 {{(pid=124199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:49:01.521775 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9fbe7e05-02b8-42f1-983f-91d71644d69d tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024cf85a89d445ff854fede06d0f9244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5975413f5548c3881ec3c868295836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:01.530444 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-9fbe7e05-02b8-42f1-983f-91d71644d69d tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/78e5c6e8-06cd-469c-98b9-f36b067796f2" status: 200 len: 1229 microversion: 2.1 time: 0.112404 May 23 12:49:01.531144 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 542/1095] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:49:01 2022] GET /compute/v2.1/servers/78e5c6e8-06cd-469c-98b9-f36b067796f2 => generated 1229 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:02.549467 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-77f05a4a-155a-415f-880a-a315398c57a4 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:02.550158 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-77f05a4a-155a-415f-880a-a315398c57a4 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 78e5c6e8-06cd-469c-98b9-f36b067796f2] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:02.556736 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-77f05a4a-155a-415f-880a-a315398c57a4 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:02.557420 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-77f05a4a-155a-415f-880a-a315398c57a4 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:02.558195 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-77f05a4a-155a-415f-880a-a315398c57a4 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:02.559140 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-77f05a4a-155a-415f-880a-a315398c57a4 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:02.573284 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.wsgi [None req-77f05a4a-155a-415f-880a-a315398c57a4 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] HTTP exception thrown: Instance 78e5c6e8-06cd-469c-98b9-f36b067796f2 could not be found. May 23 12:49:02.574934 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-77f05a4a-155a-415f-880a-a315398c57a4 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Request method failure captured: May 23 12:49:02.574934 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: request: GET /compute/v2.1/servers/78e5c6e8-06cd-469c-98b9-f36b067796f2 HTTP/1.1 May 23 12:49:02.574934 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept: application/json May 23 12:49:02.574934 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept-Encoding: identity May 23 12:49:02.574934 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Connection: close May 23 12:49:02.574934 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Length: 0 May 23 12:49:02.574934 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Type: application/json May 23 12:49:02.574934 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Host: 10.222.0.16 May 23 12:49:02.574934 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Openstack-System-Scope: None May 23 12:49:02.574934 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: User-Agent: python-urllib3/1.26.9 May 23 12:49:02.574934 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Auth-Token: gAAAAABii4Ekyf6cwYkorK1YLyy_p53XTPvC63_eNQJ2wcC3bEgrf_x8OBT3OlXsSL-P2gxXF6NAtJWekx8C05xv97nimL05Ugq9KXiXcKZIcMDZ9JTXc-NxRHw8U8Eb2OzIvM0_h-powEforGgpbP_cy7B_JnF-mpeYNUVNzfUQOPrHREBZ40s May 23 12:49:02.574934 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Id: None May 23 12:49:02.574934 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Name: None May 23 12:49:02.574934 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Identity-Status: Confirmed May 23 12:49:02.574934 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Is-Admin-Project: True May 23 12:49:02.574934 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Id: default May 23 12:49:02.574934 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Name: Default May 23 12:49:02.574934 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Id: ac5975413f5548c3881ec3c868295836 May 23 12:49:02.574934 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Name: tempest-TestVolumeBootPattern-1357796398 May 23 12:49:02.574934 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Role: member,reader May 23 12:49:02.574934 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Roles: member,reader May 23 12:49:02.576729 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ac5975413f5548c3881ec3c868295836"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ac5975413f5548c3881ec3c868295836"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ac5975413f5548c3881ec3c868295836", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ac5975413f5548c3881ec3c868295836"}]}] May 23 12:49:02.576729 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant: tempest-TestVolumeBootPattern-1357796398 May 23 12:49:02.576729 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Id: ac5975413f5548c3881ec3c868295836 May 23 12:49:02.576729 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Name: tempest-TestVolumeBootPattern-1357796398 May 23 12:49:02.576729 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User: tempest-TestVolumeBootPattern-1357796398-project May 23 12:49:02.576729 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Id: default May 23 12:49:02.576729 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Name: Default May 23 12:49:02.576729 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Id: 024cf85a89d445ff854fede06d0f9244 May 23 12:49:02.576729 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Name: tempest-TestVolumeBootPattern-1357796398-project May 23 12:49:02.576729 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: method: > May 23 12:49:02.576729 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: exception: Instance 78e5c6e8-06cd-469c-98b9-f36b067796f2 could not be found. May 23 12:49:02.576729 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: action_args: {'id': '78e5c6e8-06cd-469c-98b9-f36b067796f2'} May 23 12:49:02.577813 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:49:02.577813 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:49:02.577813 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:49:02.577813 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:49:02.577813 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:49:02.577813 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:49:02.577813 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:49:02.577813 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:49:02.577813 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:49:02.577813 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:49:02.577813 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78e5c6e8-06cd-469c-98b9-f36b067796f2 could not be found. May 23 12:49:02.577813 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:49:02.577813 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:49:02.577813 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:49:02.577813 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:49:02.577813 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:49:02.577813 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:49:02.577813 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:49:02.577813 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:49:02.577813 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:49:02.579369 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:49:02.579369 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:49:02.579369 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:49:02.579369 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:49:02.579369 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:49:02.579369 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:49:02.579369 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:49:02.579369 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78e5c6e8-06cd-469c-98b9-f36b067796f2 could not be found. May 23 12:49:02.579369 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:49:02.579369 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:49:02.579369 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:49:02.579369 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:49:02.579369 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:49:02.579369 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:49:02.579369 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:49:02.579369 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:49:02.579369 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78e5c6e8-06cd-469c-98b9-f36b067796f2 could not be found. May 23 12:49:02.579369 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:49:02.580966 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-77f05a4a-155a-415f-880a-a315398c57a4 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Returning 404 to user: Instance 78e5c6e8-06cd-469c-98b9-f36b067796f2 could not be found. {{(pid=124200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:49:02.580966 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-77f05a4a-155a-415f-880a-a315398c57a4 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/78e5c6e8-06cd-469c-98b9-f36b067796f2" status: 404 len: 111 microversion: 2.1 time: 0.031753 May 23 12:49:02.580966 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 554/1096] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:49:02 2022] GET /compute/v2.1/servers/78e5c6e8-06cd-469c-98b9-f36b067796f2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:49:03.051101 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-fd2b2fde-4926-4d5b-b6fd-9f0fc6374519 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:03.051646 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-fd2b2fde-4926-4d5b-b6fd-9f0fc6374519 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 0ec9234d-3bbf-4d1f-8780-5544e03fe111] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:03.059229 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fd2b2fde-4926-4d5b-b6fd-9f0fc6374519 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:03.059681 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fd2b2fde-4926-4d5b-b6fd-9f0fc6374519 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:03.060544 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fd2b2fde-4926-4d5b-b6fd-9f0fc6374519 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:03.060929 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fd2b2fde-4926-4d5b-b6fd-9f0fc6374519 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:03.077885 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.wsgi [None req-fd2b2fde-4926-4d5b-b6fd-9f0fc6374519 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] HTTP exception thrown: Instance 0ec9234d-3bbf-4d1f-8780-5544e03fe111 could not be found. May 23 12:49:03.079557 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-fd2b2fde-4926-4d5b-b6fd-9f0fc6374519 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Request method failure captured: May 23 12:49:03.079557 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: request: DELETE /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111 HTTP/1.1 May 23 12:49:03.079557 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept: application/json May 23 12:49:03.079557 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Accept-Encoding: identity May 23 12:49:03.079557 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Connection: close May 23 12:49:03.079557 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Length: 0 May 23 12:49:03.079557 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Content-Type: application/json May 23 12:49:03.079557 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Host: 10.222.0.16 May 23 12:49:03.079557 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Openstack-System-Scope: None May 23 12:49:03.079557 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: User-Agent: python-urllib3/1.26.9 May 23 12:49:03.079557 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Auth-Token: gAAAAABii4Ekyf6cwYkorK1YLyy_p53XTPvC63_eNQJ2wcC3bEgrf_x8OBT3OlXsSL-P2gxXF6NAtJWekx8C05xv97nimL05Ugq9KXiXcKZIcMDZ9JTXc-NxRHw8U8Eb2OzIvM0_h-powEforGgpbP_cy7B_JnF-mpeYNUVNzfUQOPrHREBZ40s May 23 12:49:03.079557 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Id: None May 23 12:49:03.079557 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Domain-Name: None May 23 12:49:03.079557 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Identity-Status: Confirmed May 23 12:49:03.079557 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Is-Admin-Project: True May 23 12:49:03.079557 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Id: default May 23 12:49:03.079557 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Domain-Name: Default May 23 12:49:03.079557 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Id: ac5975413f5548c3881ec3c868295836 May 23 12:49:03.079557 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Project-Name: tempest-TestVolumeBootPattern-1357796398 May 23 12:49:03.079557 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Role: member,reader May 23 12:49:03.079557 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Roles: member,reader May 23 12:49:03.081268 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ac5975413f5548c3881ec3c868295836"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ac5975413f5548c3881ec3c868295836"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ac5975413f5548c3881ec3c868295836", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ac5975413f5548c3881ec3c868295836"}]}] May 23 12:49:03.081268 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant: tempest-TestVolumeBootPattern-1357796398 May 23 12:49:03.081268 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Id: ac5975413f5548c3881ec3c868295836 May 23 12:49:03.081268 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-Tenant-Name: tempest-TestVolumeBootPattern-1357796398 May 23 12:49:03.081268 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User: tempest-TestVolumeBootPattern-1357796398-project May 23 12:49:03.081268 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Id: default May 23 12:49:03.081268 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Domain-Name: Default May 23 12:49:03.081268 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Id: 024cf85a89d445ff854fede06d0f9244 May 23 12:49:03.081268 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: X-User-Name: tempest-TestVolumeBootPattern-1357796398-project May 23 12:49:03.081268 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: method: > May 23 12:49:03.081268 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: exception: Instance 0ec9234d-3bbf-4d1f-8780-5544e03fe111 could not be found. May 23 12:49:03.081268 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: action_args: {'id': '0ec9234d-3bbf-4d1f-8780-5544e03fe111'} May 23 12:49:03.082187 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:49:03.082187 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:49:03.082187 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:49:03.082187 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:49:03.082187 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:49:03.082187 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:49:03.082187 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:49:03.082187 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:49:03.082187 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:49:03.082187 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:49:03.082187 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ec9234d-3bbf-4d1f-8780-5544e03fe111 could not be found. May 23 12:49:03.082187 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:49:03.082187 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:49:03.082187 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:49:03.082187 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:49:03.082187 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:49:03.082187 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:49:03.082187 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:49:03.082187 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:49:03.082187 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:49:03.083808 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:49:03.083808 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 12:49:03.083808 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 12:49:03.083808 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 12:49:03.083808 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 12:49:03.083808 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:49:03.083808 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:49:03.083808 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:49:03.083808 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:49:03.083808 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ec9234d-3bbf-4d1f-8780-5544e03fe111 could not be found. May 23 12:49:03.083808 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:49:03.083808 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:49:03.083808 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:49:03.083808 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:49:03.083808 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:49:03.083808 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:49:03.083808 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:49:03.083808 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:49:03.083808 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ec9234d-3bbf-4d1f-8780-5544e03fe111 could not be found. May 23 12:49:03.083808 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: ERROR nova.api.openstack.wsgi May 23 12:49:03.085160 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-fd2b2fde-4926-4d5b-b6fd-9f0fc6374519 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Returning 404 to user: Instance 0ec9234d-3bbf-4d1f-8780-5544e03fe111 could not be found. {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:49:03.085160 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-fd2b2fde-4926-4d5b-b6fd-9f0fc6374519 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111" status: 404 len: 111 microversion: 2.1 time: 0.034141 May 23 12:49:03.085160 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 543/1097] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 12:49:03 2022] DELETE /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:49:03.090583 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-ea5f81bf-f167-4399-9bd7-3a9582c04031 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '>' {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:03.091223 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.compute.api [None req-ea5f81bf-f167-4399-9bd7-3a9582c04031 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] [instance: 0ec9234d-3bbf-4d1f-8780-5544e03fe111] Fetching instance by UUID {{(pid=124200) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:03.097593 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ea5f81bf-f167-4399-9bd7-3a9582c04031 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:03.098047 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ea5f81bf-f167-4399-9bd7-3a9582c04031 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:03.098850 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ea5f81bf-f167-4399-9bd7-3a9582c04031 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:03.099277 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG oslo_concurrency.lockutils [None req-ea5f81bf-f167-4399-9bd7-3a9582c04031 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Lock "1aae0ced-cc5a-42cd-a102-e511b8435b39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:03.113894 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.wsgi [None req-ea5f81bf-f167-4399-9bd7-3a9582c04031 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] HTTP exception thrown: Instance 0ec9234d-3bbf-4d1f-8780-5544e03fe111 could not be found. May 23 12:49:03.115487 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-ea5f81bf-f167-4399-9bd7-3a9582c04031 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Request method failure captured: May 23 12:49:03.115487 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: request: GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111 HTTP/1.1 May 23 12:49:03.115487 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept: application/json May 23 12:49:03.115487 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Accept-Encoding: identity May 23 12:49:03.115487 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Connection: close May 23 12:49:03.115487 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Length: 0 May 23 12:49:03.115487 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Content-Type: application/json May 23 12:49:03.115487 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Host: 10.222.0.16 May 23 12:49:03.115487 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Openstack-System-Scope: None May 23 12:49:03.115487 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: User-Agent: python-urllib3/1.26.9 May 23 12:49:03.115487 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Auth-Token: gAAAAABii4Ekyf6cwYkorK1YLyy_p53XTPvC63_eNQJ2wcC3bEgrf_x8OBT3OlXsSL-P2gxXF6NAtJWekx8C05xv97nimL05Ugq9KXiXcKZIcMDZ9JTXc-NxRHw8U8Eb2OzIvM0_h-powEforGgpbP_cy7B_JnF-mpeYNUVNzfUQOPrHREBZ40s May 23 12:49:03.115487 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Id: None May 23 12:49:03.115487 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Domain-Name: None May 23 12:49:03.115487 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Identity-Status: Confirmed May 23 12:49:03.115487 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Is-Admin-Project: True May 23 12:49:03.115487 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Id: default May 23 12:49:03.115487 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Domain-Name: Default May 23 12:49:03.115487 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Id: ac5975413f5548c3881ec3c868295836 May 23 12:49:03.115487 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Project-Name: tempest-TestVolumeBootPattern-1357796398 May 23 12:49:03.115487 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Role: member,reader May 23 12:49:03.115487 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Roles: member,reader May 23 12:49:03.117086 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ac5975413f5548c3881ec3c868295836"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ac5975413f5548c3881ec3c868295836"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ac5975413f5548c3881ec3c868295836", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ac5975413f5548c3881ec3c868295836"}]}] May 23 12:49:03.117086 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant: tempest-TestVolumeBootPattern-1357796398 May 23 12:49:03.117086 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Id: ac5975413f5548c3881ec3c868295836 May 23 12:49:03.117086 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-Tenant-Name: tempest-TestVolumeBootPattern-1357796398 May 23 12:49:03.117086 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User: tempest-TestVolumeBootPattern-1357796398-project May 23 12:49:03.117086 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Id: default May 23 12:49:03.117086 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Domain-Name: Default May 23 12:49:03.117086 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Id: 024cf85a89d445ff854fede06d0f9244 May 23 12:49:03.117086 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: X-User-Name: tempest-TestVolumeBootPattern-1357796398-project May 23 12:49:03.117086 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: method: > May 23 12:49:03.117086 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: exception: Instance 0ec9234d-3bbf-4d1f-8780-5544e03fe111 could not be found. May 23 12:49:03.117086 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: action_args: {'id': '0ec9234d-3bbf-4d1f-8780-5544e03fe111'} May 23 12:49:03.118020 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: {{(pid=124200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:49:03.118020 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:49:03.118020 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:49:03.118020 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:49:03.118020 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:49:03.118020 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:49:03.118020 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:49:03.118020 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:49:03.118020 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:49:03.118020 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:49:03.118020 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ec9234d-3bbf-4d1f-8780-5544e03fe111 could not be found. May 23 12:49:03.118020 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:49:03.118020 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:49:03.118020 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:49:03.118020 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:49:03.118020 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:49:03.118020 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:49:03.118020 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:49:03.118020 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:49:03.118020 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:49:03.120006 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:49:03.120006 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:49:03.120006 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:49:03.120006 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:49:03.120006 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:49:03.120006 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:49:03.120006 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:49:03.120006 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ec9234d-3bbf-4d1f-8780-5544e03fe111 could not be found. May 23 12:49:03.120006 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:49:03.120006 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:49:03.120006 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:49:03.120006 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:49:03.120006 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:49:03.120006 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:49:03.120006 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:49:03.120006 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:49:03.120006 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ec9234d-3bbf-4d1f-8780-5544e03fe111 could not be found. May 23 12:49:03.120006 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: ERROR nova.api.openstack.wsgi May 23 12:49:03.121442 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: DEBUG nova.api.openstack.wsgi [None req-ea5f81bf-f167-4399-9bd7-3a9582c04031 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Returning 404 to user: Instance 0ec9234d-3bbf-4d1f-8780-5544e03fe111 could not be found. {{(pid=124200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:49:03.121442 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO nova.api.openstack.requestlog [None req-ea5f81bf-f167-4399-9bd7-3a9582c04031 tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111" status: 404 len: 111 microversion: 2.1 time: 0.030708 May 23 12:49:03.121442 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: [pid: 124200|app: 0|req: 555/1098] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 12:49:03 2022] GET /compute/v2.1/servers/0ec9234d-3bbf-4d1f-8780-5544e03fe111 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:49:04.433151 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-a3849df4-0661-4f72-83ff-41ce0ceac29a tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] Calling method '.version_select at 0x7f09623ffaf0>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:04.459316 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-a3849df4-0661-4f72-83ff-41ce0ceac29a tempest-TestVolumeBootPattern-1357796398 tempest-TestVolumeBootPattern-1357796398-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-975896852" status: 202 len: 0 microversion: 2.1 time: 0.030444 May 23 12:49:04.459992 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 544/1099] 10.222.0.16 () {58 vars in 1259 bytes} [Mon May 23 12:49:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-975896852 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:49:50.299635 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 12:49:50.300373 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Mon May 23 12:49:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 12:50:22.558713 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 12:50:22.559382 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Mon May 23 12:50:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 12:51:45.565456 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 12:51:45.566086 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Mon May 23 12:51:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 12:51:50.671414 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 12:51:50.672122 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Mon May 23 12:51:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 12:51:54.104183 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 12:51:54.104792 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Mon May 23 12:51:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 12:52:04.022578 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 12:52:04.023147 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Mon May 23 12:52:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 12:53:10.308014 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 12:53:10.308683 dv-cinder-836996-27-iscsi devstack@n-api.service[124199]: Mon May 23 12:53:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 12:53:42.567080 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 12:53:42.567721 dv-cinder-836996-27-iscsi devstack@n-api.service[124200]: Mon May 23 12:53:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!